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Introduction. 

In this paper we introduce some quantum analogues of the homogeneous spaces 
GL(n)/SO(n) and GL(2n)/Sp(2n) in the framework of quantum general linear 
groups. On these "quantum homogeneous spaces" , we investigate the zonal spheri- 
cal functions associated with finite dimensional representations. As a result, we will 
see that the zonal spherical functions in question are represented by Macdonald's 
symmetric polynomials P\ = P\(x\,--- ,x n ;q,i) (of type -A„_i) with t = or 
I = q* ([M2]). * ^ 

This result can be regarded as a generalization of Koornwinder's realization of 
the continuous g-Legendre polynomials by the quantum group SU g (2) ([Kl]). Our 
quantum analogue of GL(n)/SO(n) is essentially the same as the one discussed by 
Ueno-Takebayashi [UT]. As to the quantum analogue of GL(3)/SO(3), it is already 
known by [UT] that Macdonald's symmetric polynomials arise as zonal spherical 
functions. Our result contains the affirmative answer to their conjecture for the 
case where n > 3. Main results of this paper are announced in [N3]. 

Throughout this paper, we will denote by G the general linear group GL(7V) 
and by g its Lie algebra gl(N). The g-deformation of the coordinate ring A(G) of 
G = GL(N) and the universal enveloping algebra U(g) of g = Ql(N) will be denoted 
by A q (G) and by U q (g), respectively. We consider the following closed subgroup K 
of G for "quantization" : 

Case (SO): K = SO(n) = {g e GL(n) ; gg l = id„,det( 5 ) = 1} (N = n) 
Case (Sp): K = Sp(2n) = {g e GL(2n) ; gj n g l = J n } (N = 2n), 

where J n = Y^k=i e 2fc-i,2fc — e2fc,2fe-i- The corresponding Lie subalgebra of g will 
be denoted by t. After the preliminaries on the quantum general linear groups 
(A g (G) and U q (g)), we introduce in Section 2 some coideals £ q of U q (g), corre- 
sponding to the Lie subalgebras 6 = so(n) C fll(n) and t = sp(2n) C fll(2n). The 
construction of t q is carried out in the framework of L-operators as in [RTF], by 
using some constant solutions J to the so-called reflection equation. In Case (SO), 
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the coideals t q are closely related to the twisted U q (so(n)) of Gavrilik-Klimyk [GK] 
(see Section 2.4). With these coideals, we investigate the quantum analogue of the 
homogeneous spaces GL(n)/SO(n) and GL(2n)/Sp(2n) and their zonal spherical 
functions associated with finite dimensional representations. Actually we consider 
the invariant ring 

A q (G/K) := {ip e A q (G); t q .tp = 0} 

as a g-deformation of the algebra of regular functions on the homogeneous space 
G/K. In order to consider the zonal spherical functions on this quantum homoge- 
neous space (G/K) q , we also investigate the subalgebra of tq-biinvariants 

H = A q (K\G/K) := {ip e A q (G); t q .<p = y.t q = 0}. 

Representations with t 9 -fixed vectors and the structure of these subalgebras of 
A q (G) will be studied in Sections 3 and 4, respectively. In accordance with the 
classical case where q = 1, the invariant ring A q (G/K) has a multiplicity free 
irreducible decomposition as a J7q(g)-module. The algebra TC = A q (K\G/K) is 
then decomposed into the direct sum of simultaneous eigenspaces 7i (A) of the center 
of U q (g), which are parametrized by the dominant integral weights A corresponding 
to the irreducible highest weight representations V(X) with t q -tixcd vectors. Each 
simultaneous eigenspace H(X) turns out to be one-dimensional just as in the case 
where q = l. We call a nonzero element in H(X) with some normalization the zonal 
spherical function <p(X) associated with V(X). 

To describe the zonal spherical functions <ys(A) thus obtained, we will study in 
Section 5 their restriction <p(A)|x to the diagonal subgroup T of GL q (N). They 
are determined by analyzing the radial component of the central element C\ of 
U q (o), presented in [RTF]. This central clement gives rise to a q-difference operator 
acting on a subalgebra of the Laurent polynomial ring. As the eigenf unctions of the 
q-diffcrence operator, </?(A)|t are identified with Macdonald's symmetric functions 
P M (xi,--- ,x n ;q,t) ([M2]) with (q,t) replaced by (q 4 ,q 2 ) in Case (SO), and by 
(q 2 , q 4 ) in Case (Sp). As an application of this realization, we will give in Section 
6 an evaluation of the ratio Pfj)' q t / (1, l)' q t of scalar products, for the special 
values t = qi and t = q 2 , to see the coincidence with the formula proposed in 
[M3]. This computation is based on the (/-analogue of Schur's orthogonality of 
matrix elements of unitary representations of the unitary group U(n) and a result 
of Macdonald [M2] on the principal specialization of P^. 
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In this section we give a review on the quantum general linear group GL g (iV). 
Main references for this section are: Jimbo [J] and Rcshctikhin-Takhtajan-Faddeev 
[RTF] (see also [NYM] and [NUW1]). From now on, we fix the field K = Q(q) of 
rational functions in the indeterminate q as the ground field. Our presentation of 
the quantized universal enveloping algebra U q (gl(N)) is slightly different from those 
in [J] and [RTF] ; modifications are made in order to avoid the fractional powers of 
q. In the arguments of this paper the ground field K can replaced by the field C of 
complex numbers, assuming that q is a real number with \q\ =/= 0, 1. 

1.1. Quantized coordinate ring A q (GL(N)). Let V be the iV-dimensional vector 
space over K with canonical basis (vj)i<j<N- We make use of the following quantum 
i?-matrices R^ in End K (T / <8>k V): 



<i<j<N J J 



(!•!) R+ = X,..,. \ ' '« ® ^ + (« " T^Ei 

where € EikIk(V) (1 < i, j < N) are the matrix units with respect to the basis 
(vj)i<j<N- It is well-known that these matrices satisfy the Yang-Baxter equation 

(1.2) #12-^13-^23 = #23-^13-^12 ( e = ±) 

in EndK(Vi <8>k Vi <8>k V3) with V a = V for a = 1, 2, 3. Here the subscripts a, b for 
R e ab indicates the pair of components it should act on. We recall that R + — R~ = 
(q — q~ v )P with the matrix P = ^2,ij e n ® e ji representing the flip v®wnro®o. 
Note also that {Rf 2 )^ 1 = #21 an d (#12)' = #21 w &li double signs in the same 
order. 

Following [RTF], we define the coordinate ring A q (Ma,t(N)) of the quantum 
matrix space of rank N to be the K-algebra generated by the canonical coordinates 
tij (1 < i,j < N) with the fundamental relations 

(1-3) 

(1) tkitfcj qtkjtki 1 tiktjk qtjktik (i ^ j)i 

(ii) ttftkj = tkjUe, Ujtu ~ t k iUj = (q - q~ 1 )Uetkj (i < k; j < I). 

In terms of the matrix T — (Uj)\<ij<N in A q (Ma,t(N)) (g>K EndK(V), the commu- 
tation relations above are equivalently written as the Yang-Baxter equation 

(1.4) RX 2 T 2 T 1 =T 1 T 2 RX 2 in 4,(Mat(JV)) ® K End K (F ® K V). 

This algebra A q (Mat(N)) has a distinguished central element 
(1-5) det 9 (T) = V {-qY [w) t w(l)1 ---t w{N)Nl 

called the quantum determinant. Here ©at is the permutation group of the indexing 
set {1, 2, • • • , N} and, for each w & &n, stands for the number of inversions in 
w. The coordinate ring A q (GL(N)) of the quantum general linear group GL q (N) 
is then defined by adjoining the inverse of the quantum determinant det g (T) to 
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A q (M&t(N)): A q (GL(N)) = ^(Mat^))^,^)" 1 ]. This algebra has a structure 
of Hopf algebra such that 

(1.6) &(tij) = 2^ fe=1 * ife ® ifc -?' £ ( ti ^ = ^' 

for 1 < i,j < N. In the matrix notation, these formulas will be written as A(T) = 
T®T and e(T) = idy. Note also that det 9 (T) is a group-like element, namely, 
A(det,(T)) = det g (T)®det g (T) and e(dct,(T)) = 1. The antipode S of A q (GL(N)) 
is the IK-algebra anti-automorphism such that 

(1.7) TS(T) = S(T)T = id v , 

where S(T) = (S(ty))i<ij<jv. 

1.2. Quantized universal enveloping algebra U q (gl(N)). Let P be the weight 
lattice for GL(iV); it is the free Z-module of rank N with canonical basis (£j)i<j<N 
and we fix a symmetric bilinear form ( , ) :PxP^Z such that (e,, ej) = Sij for 
1 < i,j < -W- Through this pairing, we will frequently identify P with its dual 
P* = Homz(P, Z). We will also use the notation of simple roots: a k = e k — e k+ i 
for 1 < k < N- 1. 

The quantized universal enveloping algebra U q (gl(N)) is the IK- algebra gener- 
ated by the symbols q h (h e P*) and e k , f k (l < k < N — 1) with the following 
fundamental relations: 

(1.8) 

(i) q° = l, q h .q h ' =q h+h \ 

(ii) q h e iq - h = q< h ' a *>ei, q h fiq~ h = q~ {h ' ai) ft, 

(iii) eifj - fjei = % - — , 

(iv) e?e,- -(q + q~ 1 )e i e :j e i + e,e? = (\i - j\ = 1); e^e,- = e^a (\i - j\ > 1), 

(v) fffj -(q + q-'Wjfi + fjf? = (\i - j\ = 1); fifj = fjfi (\i - j\ > 1), 

where h, h' G P* and 1 < i, j < N — l. We take the following Hopf algebra structure 
of U q (Ql(N)): 

(1.9) 

(i) A(q h ) = q h ® q\ e(q h ) = 1, S(q h ) = q~ h , 

(ii) A(e fe ) = e k ® 1 + 9 £ *- £ *+i ® e fe , e(e fc ) = 0, S{e k ) = -q- ek+ek+1 e k , 

(iii) A(/ fe ) = f k ® g- e *+ £ »+i + 1 ® / fe , e (/ fc ) = 0, S(/ fc ) = -f kq e "- ek+1 , 

where h € P* and 1 < k < N — 1. We use the notation i/ 9 (t) to refer the 
Hopf subalgebra K[g' 1 ; (/i e P*)] of £/ g ({jl(iV)) corresponding to the diagonal Lie 
subalgcbra t C Ql(N). 

In this paper, we will extensively use the L- operators L^, Lr. g U q (gl(N)) as in 
Reshetikhin-Takhtajan-Faddeev [RTF]; these play the role of root vectors of gl(N). 
As is stated in [J], there is a unique family of elements E i3 (1 < i, j < N, i ^ j) in 
U q (gl(N)) such that 

(1.10) (i) E i<i+1 = e u E i3 = E ik E k3 - qE k3 E lk (i < k < j), 

(ii) E 1+ i,i = fi, E^ = E ik E kj - q~ 1 E k jE ik (i > k > j). 
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With these elements, define the elements hf- e U q (gl(N)) by 
(1.11) 

(i) L+ = q*% L+ = (q- q-^Ejt (i < j), L+ = (i > j) 

(ii) Ltf = g- £ ', Lr. = -(g - q-^E^ (i > j), LJ. = (i < j). 

Then it is known by Jimbo [J] that the the matrices = J2ij e ij ® m 
EndK(V) (g>K U q (gl(N)) satisfy the following Yang-Baxter equations: 

(1.12) R+ 2 L\L\ = L\L\R+ 2 (e = ±) and R+ 2 L+ L~ = L~ L+ R+ 2 . 

We also remark that, for the Hopf algebra structure of U q (Ql(N)), the matrices 
satisfy 

(1.13) A(L £ ) = L £ ®L £ and e(i e ) = idy (e = ±). 

This fact was fundamental in the framework of Rcshetikhin-Takhtajan-Faddeev 
[RTF]. We remark that the Yang-Baxter equations (1.12) assure that there exists 
a K-algebra homomorphism py : U q (gl(N)) — > End]^(V) such that 

(!- 14 ) fl±= E 1 < 1J < Jv e «®M^)- 

The vector space V, regarded as a left t/g(g[(JV))-module, is called the vector rep- 
resentation of U q (Ql(N)). 

The square S 2 of the antipode of U q (gl(N)) is an automorphism of the Hopf 
algebra U q (gl(N)). For any a e U q (Ql(N)), we have 

(1.15) S 2 {a) = q- 2p aq 2p for any a E U q (g[(N)), 

where q 2p is the group- like element of U q (g) corresponding to the sum of positive 
roots 

(1.16) 2p = ]T fe=i 2(JV-fc)e fe . 

1.3. Pairing between A q (GL(N)) and U q (gl(N)). Let U and A be two Hopf 
algebras over K. We say that a K-bilinear form ( , ) : U x A — > K is a pairing of 
Hopf algebras if it satisfies the following three conditions: 

(1.17) (i) {a.b,ip) = (a®b,A A (<p)) and (ly, <p) = e A (<p), 
(ii) (a, ip.ip) = (Au(a),<p<8> ip) and (a, 1 A ) = £u(a), 
(hi) (Su(a),ip) = (a,S A (ip)), 

for all a,b <E U and <p, ip £ A. Through such a pairing, one can define a [7-bimodule 
structure on A by setting 

(1.18) a.tp = (id A ®a) o A A (ip) and <p.a = (a <g> id^) ° A A {ip), 

for any a e [/ and ip E A. In the right-hand side, the symbol a stands for the linear 
functional on A induced from a e {/ by the pairing. The algebra A then becomes 
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an algebra with two-sided U -symmetry , in the sense that both the multiplication 
A ®k A — > A and the unit homomorphism K — > A are homomorphisms of U- 
bimodules. As to the [/-bimodule structure of A, we have 

(1.19) a.S A (<p) = S A (<p.Su(a)) and S A (<p).a = S A (Su(a).<p), 

for all <p £ A and a £ U. 

We now take the Hopf algebras U q (gl(N)) and A q (GL(N)) for {/ and A above. 
As to these Hopf algebras, it is known that there exists a unique pairing of Hopf 
algebras ( , ) : U q (gl(N)) x A q (GL(N)) -» IK such that 

(1.20) {Lf,T 2 ) = Rf 2 and (i ± , det,(T)) = g ±1 idy . 

By this pairing, the algebra A q (GL(N)) becomes an algebra with two-sided symme- 
try over U q (gl(N)). In terms of the L-operators, the ?7 g (0[(iV))-bimodule structure 
of A q (GL(N)) is described as follows: 

(1.21) L\.T 2 =T 2 R\ 2 and T 2 .L\ = R\ 2 T 2 (e = ±). 

By means of the [/ 9 (g[(AQ)-bimodule structure, the square S 2 of the antipode of 
A q (GL(N)) is described as S 2 (<p) = q 2 P.ip.q- 2 P for any ip £ A q (GL{N)). 

We say that a left U q (gt(N))-modu\e is P- weighted if it has a if-basis consisting 
of weight vectors with weights in P. Let P + be the set of all dominant integral 
weights in P: 

(1.22) P+ = {\ = 2j fe=1 A fc e fe £P; Ai > A 2 > • • • > A at}. 

For each A £ P + , we denote by V(X) the unique irreducible finite dimensional 
left [/ g (g[(iV))-module with highest weight A; it is characterized as the unique irre- 
ducible left U q (gt(N))-modu\c generated by an element u(X) such that q h .u(X) — 
q< h '^u(X) for h £ P* and e k .u(X) = for 1 < k < N - 1. It is well-known that 
any finite dimensional P-wcighted J7q(g((iV))-module is completely reducible and 
that any finite dimensional irreducible P- weighted {7 g (0[(AT))-module is isomor- 
phic to V(X) for some dominant integral weight A £ P + (sec [L, R]). Furthermore, 
each irreducible C/ 9 (0[(A r ))-modules V{X) is obtained as the "differential representa- 
tion" from the underlying right A g (GL(A^))-comodule structure of V(X). All these 
V(X) (A £ P+) are realized as right J 4 9 (GL(A^))-subcomodules of A q (GL(N)) by 
means of standard monomials of quantum minor determinants (see [TT, NYM], for 
instance). 

We denote by W(X) the K-vector subspace of A q (GL(N)) spanned by the ma- 
trix elements of the right J 4 (J (GL(A f ))-comodule V(X). Then W(X) is an irreducible 
J7«j(0l(A^))-bimodule isomorphic to the tensor product HomK(T^(A), K) ®k V(X). 
Furthermore, the regular representation A q (GL(N)) has the irreducible decompo- 
sition 

(1.23) A q (GL(N)) = 0^ p+ W(X) 

as a {7 9 (g[(Ar))-bimodule, which corresponds to the Peter-Weyl Theorem for the 
quantum unitary group U q (N) (see [HI, NYM, W], for instance). We also re- 
mark that the K-subspace W(X) of A q (GL(N)) is characterized as the simultaneous 
eigenspace of the center of U q (gl(N)): 
(1.24) 

W(X) = {(fi£ A q (GL(N)); C.ip = x\(C)<f for any central element C £ U q (gl(N))}, 
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where X\{C) stands for the eigenvalue of the central element C acting on the 
irreducible representation V(X). 

1.4. Involutions on A q (GL(N)) and U q (gl(N)). In this subsection, we recall 
some involutions on A q (GL(N)) and U q (gl(N)), related to the quantum unitary 
group Uq(N). 

For the moment, let be K an arbitrary field and fix an involutive automorphism 
chc, which we call the conjugation of K. A Hopf algebra A over K is called a Hopf 
* -algebra if it has a pair (t, r) of involutive, conjugate- linear mappings 1, t : A — > A 
such that 

(1) 1 is an algebra anti-automorphism and a coalgebra automorphism. 

(2) r is an algebra automorphism and a coalgebra anti-automorphism. 

(3) The antipode S of A is expressed as S = t o r. 

We will call the involution 1 the ^-operation of A and write t(a) = a* for o e A. 
Note that, if A has an involutive, conjugate linear mapping t satisfying (1) and the 
condition (t o 5) 2 = id^, it becomes a Hopf *-algebra together with the involution 
t = 1 o S. The condition (1 o 5) 2 = id^ is sometimes referred to as Woronowicz's 
condition (see [W]). 

Returning to the previous setting, we take the field Q(q) of rational functions in 
q as the ground field K. In this case, we set c = c for any c e Q(g). When we take 
IK = C instead, we denote by c the complex conjugation and assume that q is a real 
number with \q\ ^ 0, 1. 

Either A q (GL(N)) or U q (gl(N)) has a structure of Hopf *-algebra corresponding 
to the real form U(iV) or u(iV). As to A q (GL(N)), we can take the ^-operation 
such that 

(1.25) % j =S(t j i) (l<i,j<N) and det 9 (T)* = detg(T)" 1 . 
The corresponding r is given by the "transposition" : 

(1.26) T(Uj) = tji (1 < i,j < N) and r(det 9 (T)) = det 9 (T). 
On the other hand, as to U q (Ql(N)), we can take the ^-operation such 

(1.27) Lt* = S{Ll) (l<i,j<N). 

At the Chevalley generators, this involution takes the values 

(1.28) {q h )*=q h (heP*), e k *=q- 1 f k tk, fk* = qt^e k (l<k<N-l), 
where t k — q ek ~ £k + 1 for 1 < k < N — 1. The corresponding r is given by 
(1-29) < L %) = L l 0-<hj<N). 

These Hopf *-algebra structures on A q (GL(N)) and U q (gl(N)) are compatible 
with the pairing, in the sense that 

(1.30) (a*, ip) = (a,r(^)), (r(a), <p) = (^) 

for all a e J7 g (g[(A^)) and <p e J 4 (J (GL(A^)). From this compatibility, we have the 
following formulas concerning the U q (g)-bimodule structure of A q (GL(Nj): 

(1.31) a.<^* = (r(a).if)* and a.r((p) = r(<fi.a*), 
for all v5 G A 9 (GL(A)) and a e l/ g (fl[(JV)). 
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§2. Quantum analogue of some Lie subalgebras of gi(N). 

In this section, we introduce quantum analogues of the Lie subalgebras t = 
So(n) C gi(n) and 6 = sp(2n) C gt(2n). We will define a family of coideals t q of 
the quantized universal enveloping algebra U q (g[{N)) (with N = n or 2n) which 
"tends" to f as q — > 1. From this section on, we denote by G the general linear 
group GL(N) and by g its Lie algebra gl(N). 

2.1. Definition of the coideal t q . Keeping the notation in the previous section, 
we denote by V the vector representation of U q (g) = U q (gt(N)) with canonical basis 
( v j)i<j<N- We consider the following two types of Lie subalgebras 6 of gl(N) = 
Endue (^0 for quantization: 

(2.1) 

Case (SO): t = so(n) = {X £ End K (V); X + X* = 0} with N = n 

Case (Sp): t = sp(2n) = {X e End K (V); XJ n + J n X t = 0} with N = 2n, 

where J n = Y^k=i e 2fe-i,2fe — e 2 k,2k-i- In order to "quantize" this setting, we define 
the matrix J(a) e EndK(V r ), depending on the parameters a — (a\, ■ ■ ■ , a n ) in the 
algebraic torus (K*)™, by 

En 
k=i e kk a k , 

En 
, ,(e 2 fc-i,2fc - qe 2 k,2k-i)ah- 
k=l 

Note that J (a) is an invertible matrix and that J(a)^ 1 = J(a _1 ) in Case (SO) and 
J(a)- 1 = -q- l J{a- r ) in Case (Sp). 

Fixing the parameter a £ (K*)™, we introduce a coideal t q = t q {a) of U q (g) by 
using the matrix J = J(a). Define a matrix M = M(a) in EndK(V r ) ®k U q (g) by 
the formula 

(2.3) M:=L+- JS(L-y J' 1 . 

Writing the matrix M in the form M = ^ i . ® Mjj , we denote by t q = t q (a) 
the vector subspace of U q (g) spanned by the matrix elements My (1 < i, j < N): 

( 2 - 4 ) : = E^,,^ C W 

We show first that the vector subspace 6 9 is actually a coideal of U q (g). 

Proposition 2.1. For any a £ (K*) n , the K-vector subspace t q — t q (a) is a coideal 
ofU q (g). To be more precise, the matrix M — M(a) satisfies 

(2.5) A(M) =L+®M + M®JS{L-) t ,r 1 and e(M) = 0. 

Proof. By A(L+) = L+®L+ and A(5(L")*) = S , (L"-)*®S'(L-) t , one has 

(2.6) A(M) J = L+0L+J + JSiL-y&SiL-f 

= L + <g)(L+J - JS(L-f) + (L+J - JS(L-)*)®S(L-y 
= L+®MJ + MJ®S{L-y. 

The assertion e(M) = is clear, since e(£ + ) = e(S(L~Y) = idy. □ 



Macdonald polynomials on quantum homogeneous spaces 



9 



2.2. Reflection equation for the matrix J. We now explain the reason why the 
matrices J = J(a) (a € (K*) n ) in (2.2) are chosen for the quantization of the Lie 
subalgebras so(n) and sp(2n). As for these matrices J = J(a), the following lemma 
is fundamental. 

Lemma 2.2. For any a G (K*) n , the matrix J = J(a) defined above satisfies the 
reflection equation 

(2.7) i?]*2^2-Ri2 "^1 = J2R12 

in Endue (V' ®k V), where R^ 2 2 stands for the matrix obtained from Rf 2 by trans- 
position in the second component. 

Lemma 2.2 can be checked by direct calculations. For the reflection equations 
and related topics, we refer the reader to [Ku]. 

In our context, the meaning of the reflection equation above for J = J(a) can 
be formulated as follows. 

Proposition 2.3. Given a matrix J = Xa<i,j<jvAj' e *j * n Endj^V), define an 
element wj in the tensor product V <X>k V by 

(2.8) = V ViJijt&Vj € V ®k V. 

On the other hand, define a family of elements < i,j < N) in U q (o) as in 

(2.3). Then we have Mij.wj = for I < i,j < N if and only if the matrix J 
satisfies the reflection equation (2.7). 

Proof. Let us denote by v = (v\, ■ ■ ■ , vn) the row vector representing the canonical 
basis for V. Then the action of the L-operators on v is described as follows: 

(2.9) L+.w 2 = v 2 i?+ , S(L-){.v 2 = v 2 i?+ * 2 . 

The second formula is obtained from (-R^) -1 = R£i an d Rti* 1 = R-yi^ ■ Noting 
that wj — vJ (g> v*, we compute 

(2.10) L+J.wj = L+.(w 2 J 2 <g> v 2 ) Ji = L+.v 2 J 2 O Lf.vl Ji 

= v 2 i?+ J 2 <8> R\ 2 2 v 2 Ji = v 2 i?+ J 2 R+ 2 12 Jj O v 2 . 

Similarly we have 
(2.11) 

JS(L-y.wj = JiS(L-)\.(v 2 J 2 ® v*) = J 1 5(L-)i.v 2 J 2 <8> S(i _ )l.v| 
= Jiw 2 R+ 2 2 J 2 O i?+ v 2 = v 2 * 2 J 2 i?+ ® v 2 . 

Hence we have L + J.w.j — JS(L~y.wj if and only if the matrix J satisfies the 
reflection equation (2.7). □ 

Recall that the tensor product V ®k V has the irreducible decomposition V ®k 
V = V+ © V_ as a left £/ g (jj)-module into the "symmetric part" V+, isomorphic to 
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the highest weight module V(2ei), and the "anti-symmetric part" V-, isomorphic 
to V(e\ + e 2 ). These two components are explicitly given as 

(2 - 12) 

V+ = > Kvk <S>Vk+ > K(qvi ® v,; + v-j ® vj), and 

V- = Kfe <g> d, - qvj <g> Ui), 

respectively. Note that the element w.j for J = J (a), defined in Proposition 2.3, 
takes the form 

En 
Vk <8> Ufcdfc, 
k— 1 

En 
(U2fc-1 <S> «2fe - 0^2fc (8> U2fc-l)afe- 
fe=l 

The "quadratic form" wj belongs to V+ in Case (SO), and to V- in Case (Sp). 
Furthermore, the coideal t q is so chosen that t q should annihilate the clement wj. 

2.3. Some remarks on t q . In the limit as q — > 1, the elements (q — g _1 ) _1 ¥y 
recover a K-basis for the Lie subalgebra 6 = so(n) or {* = sp(2n) , if = q Sk for 
some Sk £ Z (1 < fc < n). We give here explicit formulas of the elements My for 
the comparison with the case 5 = 1. In Case (SO), they are written as 

(2.14.a) Mij = L± - ataj 1 S(LjJ for 1 < * < j < n, 

and = for i > j. Note that the elements Mk,k+i are also written as Mk,k+i = 
(<? - q- l )q e "{fk - dkall^ek) for 1 < fc < N - 1, where i fe = gr £ *- £ *+i. In Case 
(Sp), the nonzero elements among My are classified into the following four groups: 

(2.14.b) 

(i) M 2r _l,2r-1 = -M 2r ,2r = - (1 < T < «), 

(ii) M 2r _l,2r = L^ r _ 12r , M 2r ,2r-l = qS(L2 rt2r _ 1 ) (1 < T < n), 

(hi) M 2r -i, 2s -i = £t-i,2 S -i - ^^^(L^^r) and 

M 2r ,2s = L+ r 2s - a r a- 1 S(L 2s _ 12r _ 1 ) (1 < r < s < n), 

(iv) M 2r _i,2 S = L+ r _ 12s + q- 1 a r a- 1 S(L 2s _ 12r ) and 

M 2r , 2s _i = L+ r 2s _ 1 + qa r a- 1 S(L 2s 2r _ 1 ) (1 < r < s < n). 

In order to see what happens as q tends to 1, one has only to note that Lfj/(q — 
q^ 1 ) — ► X,^ for i ^ j and that (q Ci — q~ ei )/(q — q^ 1 ) — > X^, where (Xij)ij is the 
basis for jjl(iV) corresponding to the matrix units. 

From Proposition 2.1, it follows that the left ideal J7 g (g)6 9 and the right ideal 
^qUqio) are both coideals of U q (g). As for generator systems of these ideals, we 
have 

Proposition 2.4. Both the left ideal U q (g)t q and the right ideal t q U g (g) have the 
following generator system: 

Case (SO): M fe , fe+1 = L+ fe+1 - aua^S^^) (1 < k < n - 1). 

Case (Sp): M 2r -i,2 r -i = o' 2 ^ 1 - q e2r (1 < r < n), 

M 2T -l,2r = ^2" r -l,2r' M^2r-1 = ^(^r^r-l) < r < «)i 

M 2r ,2r+i = L% r 2r+1 + qa r a~l x S{L^ r+2ar _ x ) (1 < ^ < n - 1). 
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Proposition 2.4 can be proved by using commutation relations between the ele- 
ments Lfj and S(L^): 

(2.15) S(L 2 )R+ 2 L+ = L+R+ 2 S(L 2 ), 

which is a direct consequence of (1.12). One of the commutation relations is 

(2.16) qS{Lj i )L++(q-q- 1 ) 1 £ S{Lj ll )L+ = qL±S{LT.) + {q-q-') £ \ L f S(L;.). 

H>i v<j 

This relation is related with the recurrence relation (5.33) which will play the key 
role in the computation of radial components of a central element of U q (g) in Section 
5. Since we will not explicitly use Proposition 2.4 hereafter, we omit the detail of 
its proof. We remark that, in Case (SO), the generators for the left ideal U q (Q)t q in 
Proposition 2.4 are the same as Ueno and Takebayashi used to define the quantum 
analogue of GL(n)/SO(n) in [UT], while our coideal t q gives the whole set of root 
vectors. 

2.4- Relation to twisted quantized universal enveloping algebras. It is natural 
to ask which subalgebra of U q (g) is appropriate as an object that should play the 
role of the subalgebra U(t) of U(q). It seems to be a common understanding 
that the quantized universal enveloping algebra U q (g) does not have as many Hopf 
subalgebras as the classical U(g) does. This point is discussed in [H2], in its dual 
version. In this context, it is necessary to take subalgebras of U q (o) that are not 
closed under the coproduct into consideration, to recover the degrees of freedom of 
subgroups in quantum groups. The arguments in this paper can be reformulated 
from this point of view, namely in the framework of twisted quantized universal 
enveloping algebras. Although we will not use this structure explicitly, it should 
be noted that, in the discussion of invariant rings which is a subject from the next 
section on, the central role is played by the left or right ideal generated by t q , not 
by the coideal t q itself. In Case (SO), our definition of the coideal t q is closely 
related to the g-deformation of U(so(n)) due to Gavrilik-Klimyk [GK]. 

Recall that our coideal £ q is defined by using the matrix M formed in (2.3) 
additively from L + and S(L~). As a generator system for U q (g)t q , this matrix M 
can be replaced by any of the following four matrices: 

(2.17) -S(L+)MJ = S(L+)JS(L-y - J 

L-^M 1 = ZrJ* (£,+)* - J* 
(L-)*QJ _1 M = (L-)*QJ- 1 L+ - QJ- 1 
-5(L+) t g- 1 M t (J- 1 )* = SiL+fQ-^J-ySiL-) - Q-^J- 1 )*, 

where Q = diag(<7 2 ' Ar_1 \ q 2 ( N ~ 2 \ • • • , 1) is the representation matrix of the group- 
like element q 2p on the vector representation. The last two equalities in (2.17) are 
obtained by using the description (1.15) of S* 2 . We can use any of the four matrices 



(2.18) S(L+)JS(L-y, L-J^L+f, (L-)*QJ- 1 L+ and SiL+yQ- 1 ^- 1 ) 1 S{L-). 
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to define multiplicatively a subalgcbra of U q (g) corresponding to the subalgebra 
£7(6) of U(g). To fix the idea, let us take the matrix 

(2.19) K = S(L+)JS(L-y 

and denote by U q w (i) the K-subalgebra of U q (g) generated by the matrix elements 
(1 <i,j< N) of K. Then the left ideal U q (g)£ q is described as 

(2.20) U q (g)t q = Pr/twm ^(0)(« " £(«)) = Ei<- <N U M(K l3 - e{K l3 )). 

z — ' a£Uq (?) L — '1<i,j<N 

This type of subalgebras t/* w (£) defined above are analogue of the "twisted Yan- 
gians" introduced for Yangians by G.I. Olshanski [O]. These "twisted" subalgebras 
have an advantage in the point that the commutation relations for the generators 
are described neatly, again by reflection equations. In fact one can show that the 
matrix K satisfies a reflection equation similar to (2.7) (cf. the proof of Proposition 
4.4 in Section 4). Furthermore, U^^t) becomes a coideal of U q (g) (except for the 
condition on the counit). 

In Case (SO), the twisted quantized universal enveloping algebra U q w (so(n)) is 
already found in the work of Gavrilik-Klimyk [GK] , although the connection with 
reflection equations is not apparent in their presentation. One can show that the 
subalgebra l/* w (so(n)) is generated by the elements Kjj + i (1 < j < n — 1) on the 
subdiagonal: 

(2.21) K jij+ i = (q- q-^iajtjhj - a 3+l f 3 ). 
Assuming that a — (q 71-1 , q n ~ 2 , ••• ,1), take the elements 

(2.22) e j =fj-qtJ 1 e J (l<j<n-l), 

so that Kjj + i = —(q — q~ 1 )q n ~ : >~ 1 $j. Then one can check that the generators 
01, • • • , 9 n -i OI the subalgebra C/* w (so(n)) satisfy the commutation relations 

(2.23) (i) e^j-iq + q-^e^ + e^ = -e 3 if \i-j\ = i, 

(ii) 6 i Oj = j 6 i if > 1, 

as in the definition of q-deformation of U(so(n)) of Gavrilik-Klimyk. We finally 
remark that this algebra J7* w (so(n)) arises naturally as the commutant of a q- 
analogue of the oscillator representation (see [NUW2] ) . 

§3. Representations with 6 9 -fixed vectors. 

We now investigate the irreducible representations with fi 9 -fixed vectors. As in 
Section 2, we fix the parameter a — (a\, ■ ■ ■ ,a n ) £ (K*)" and set J = J(a) and 
t q = t q (a). 

3.1. t q - fixed vectors. Recall that, for each dominant integral weight A G P + , 
there exists an irreducible left ?7q(g)-modulc V^A) with highest weight A, uniquely 
determined up to isomorphism. For the coideal t q = t q (a) of U q (g), defined in 
Section 2, we denote by V{\)t q the vector subspace of all £ g -fixed vectors in V(X): 

(3.1) V(X) tg :={veV(\);t q .v = 0}. 

In this section, we will prove the following theorem. 
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Theorem 3.1. (1) For any A e P + , one has dim.K V(X)t q < 1. 

(2) The left U q (o) -module V(A) has a nonzero £ q - fixed vector if and only if the 

dominant integral weight A = X^feLi ^fc£fc satisfies the following condition: 

Case (SO): X k - A fe+1 e 2Z (1 < k < n - 1), 
Case fSpj: A 2 fc-i = A 2 fc (1 < k < n). 

We remark that Theorem 3.1 for Case (SO) is already announced by Ueno- 
Takebayashi [UT]. We first prove statement (1) of Theorem 3.1. 

Lemma 3.2. Let v be a nonzero \ q -fixed vector in V(X) (A G P + ). Decompose v 
into the sum of weight vectors v = X^gp w m? so that q h -v jx = v^qC 1 '^ for all h e P* . 
Then one has v\ ^ 0. 

Proof. By setting, M — — J~ 1 MJ, we take the generators 

(3.2) M ij = S(Lj i )-(J- 1 L+J) ij (l<i,j<N) 

for the coideal t q . Note that, if i < j, the element Mjj is nonzero and its leading 
term S^J^ has weight — ej. Under the lexicographic order of P, let ^ be the 

maximum of all ^ e P such that ^ 0. In the equation M^v = for i < j, we 
take the component of weight /x + — e.,-, to obtain SlLj^v^ — for all i < j. 
This means that v^ is a highest weight vector of V(X). Hence we have /xo = A, 
namely v\ =/= 0. □ 

Suppose that the U q (g)-module F(A) (A e P + ) has a nonzero fi^-fixed vector v. 
Then Lemma 3.2 implies v\ ^ 0. If u> is another J ? -fixed vector, there is a constant 
c£ K such that w\ — cv\ since dims V(X)\ = 1. Then the difference w — cv is a 
fiq-fixed vector with (w — cw)a = 0. By Lemma 3.2 again, one has w — cv = 0, i.e., 
w = cv. This means that dims V(X)t q < 1, as desired. 

3.2. The rank-one case. Before the proof of statement (2) of Theorem 3.1, we 
consider the case of quantum analogue of the Lie subalgebraso(2) of g[(2). Although 
Theorem 3.1 for this case is already known by Koornwindcr [Kl], we give here a 
direct proof of this statement for completeness (see also [N2] , [NM3] ) . 

In this case, the coideal fi 9 is generated by a single element 

(3.3) M 12 = (q-q- 1 )q^(f-at- 1 e), 

where we set / = /i, e = e\, t = q Cl ~ C2 and a — ai/a 2 . Consider the dominant 
integral weight 

(3.4) A = Aid + A 2 e 2 = £e 1 + A 2 (ei + e 2 ) with £ = X 1 - A 2 e N. 

Then V(X) is an [l + 1) dimensional representation and one can take a basis 
{uq, Mi, • • • , U(} for V(X) such that 



(3.5) q h . Uj = q^ x - ja ^ Uj , e.u, = \j] Uj - U f. Uj = [£ - j]u j+1 
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for < j < £, where [j] = (qi — q j )/(q — q 1 ). One can easily show that an 
element 

(3.6) v = ,".<:> e v(X) 

satisfies the equation (/ — at~ 1 e).v = if and only if the coefficients satisfy the 
recurrence formula 

(3.7) aq- e +^+ 2 [j + l] Cj+1 = [£-j+ l] Cj -_i 

for < j < £ with boundary condition c_i = C£ + i =0. ft is immediately seen that 
the equation (3.7) has no solution if £ is odd, and that, if £ is even, the solutions of 

(3.7) arc explicitly given by 

(3.8) c 2k = (-l)fc ffl -Y {q ~T ,q ' )k c (0 < k < 1/2), 

(q • ,q ' )k 

c 2 fe+i=0 {0<k<£/2), 

where (a; q)k = (1 — o)(l — aq) ■ ■ ■ (1 — aq k ^ 1 ). This proves Theorem 3.f for the 
Case (SO) with N = n = 2. 

3.3. Proof of Theorem 3.1.(2). Next we prove the "only if" part of statement 
(2) of Theorem 3.1 for the general case. 

Case (SO): This assertion is reduced to the rank-one case. For each k with 1 < k < 
n— 1, we consider the subalgebra U q (Qk) of U q (g) generated by q ±ek , q ±ek+1 , e k and 
fk- Note that M ky k+i € U q (gk) for 1 < k < n — 1. For a fixed k, the U q (g)-module 
F(A) (A e P+) is decomposed into a direct sum 

(3.9) V(X) = W x © • • • © W m 

of irreducible <7 g (gfc)-submodules. We denote by ^ — fJ- k ^e k + fJ^^ek+i the 
highest weight of Wj for 1 < j < m. In the decomposition above, we may also 
assume that each Wj is stable under the action of the subalgebra U q (t) = K[q h (h € 
P*)] of U q (o); decompose the kernel of the operator e k : V(X) — > V(X) by the 
action of U q (i), if necessary. Let now v be a nonzero 6 9 -fixed vector in V(X) and 
decompose it in the form 

(3.10) v = w\ H + w m with Wj G (1 < j < m). 

Then the summands Wj are annihilated by Mk,k+i, since Hj (1 < j < m) are 
all C/ 9 (g / t)-submodules. Hence one sees that {^\a k ) € 2Z if u>j ^ 0, by the 
result of the rank-one case. Taking the component of weight A of v, one has v\ = 
(wi)\+- ■ ■+{w rn )\. Since v\ 7^ by Lemma 3.2, one has {wj)\ ^ and e k .(vjj)\ = 
for some j. Hence, X k e k + Afe+iefe+i is the highest weight of Wj. This means that 
Afe£fc + Xk+i^k+i — A 4 ^ • Hence, one has (A, a k ) & 2Z for 1 < k < n — 1. 

Case (Sp): Let w be a nonzero t g -fixed vector in V(X) and decompose it into the 
sum of weight vectors v ~ S/i'V' where v\ ^ by Lemma 3.2. Recall that the 
coideal £ q contains the elements M 2r -i,2r-i = <z C2r ~ 1 — q e2r (1 < r < n). Since 
(q^r-i _ q e 2r^_ Vx — ( q \2r-i _ q x ^^ Vx _ Q ; one has X 2r -i = X 2r as desired. 
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Thus we have proved the "only if" part of Theorem 3.1.(2). 

The "if" part of Theorem 3.1.(2) is proved in a constructive manner. From now 
on, we denote by P { + the set of all dominant integral weights satisfying the condition 
of Theorem 3.1.(2): 

(3.11) 

Case (SO): P+ := {A e P + ; (A, a k ) e 2Z (l<fc<n-l)}, 
Case (Sp): P E + := {A e P + ; (A, a 2k -i) =0 (1 < k < n)}. 

Denoting the fundamental weights by A r = Y^k=i tk (1 — r — ^0' we have the 
following alternative expression of P { + : 

(3.12) Case (SO): P.+ = V 2NA r +ZA„, 
Case (Sp): P+ = V NA 2r + ZA 2n , 

Z — ^r— 1 

where N = {0, 1,2, •••}. It is clear that the one dimensional representations 
V(£An)(£ G Z) have nonzero tq-fixcd vectors. 

We start with constructing nonzero fig-fixed vectors in V(2A r ) for Case (SO) and 
in y(A 2r ) in Case (Sp), for 1 < r < n. For this purpose we make use of the g-exterior 
algebra f\ q (V); it is the quotient algebra of the tensor algebra T(V) = 0^L o ^® <i 
modulo the two-sided ideal generated by the "symmetric part" V + of V <8>k V. Let 
us denote the multiplication in this g-exterior algebra by A. Then /\ q (V) is the 
K-algebra generated by the elements vi, ■ ■ ■ ,vn with fundamental relations 

(3.13) v k A v k = (1 < k < N) and qv t A Vj + Vj A Vi = (1 < i < j < N). 

Note that the q-exterior algebra f\ (V) is an algebra with Lf g (^-symmetry gen- 
erated by the vector representation V = ©fclo^fc- Namely the multiplication 
A q ( v ) ®K A q ( v ) A q ( v ) and thc unit homomorphism IK -> A 9 00 are U q(o)- 
homomorphisms. Furthermore, it decomposes as 

(3-14) A,(^ = ©^oA^ - ith A>)^^)' 

into irreducible components. Note also that, for each < r < N, the U q (o)- 
submodule /\q(V) nas the basis 

(3.15) v kl A Ufc 2 A • • • A v kr (1 < fci < k 2 < ■ ■ ■ < k r < n). 

Lemma 3. 3. A. In Case (SO), the U q (g) -module /\ r (V) ®k A q (V) has the t q -fixed 
vector 

(3.16) w r :=y^ v kl A • • • A v kr ® v kl A ■ ■ ■ A v kr a kl ■ ■ ■ a kr 

'l<fci <-<k T <N 

for 1 < r < n. Hence V(2A r ) has a nonzero t q -fixed vector for 1 < r < n. 

Proof. In order to obtain a nonzero t 9 -fixed vector in Ag(^0®KAq(^0: we construct 
an intertwining operator 

(3.17) $ : (V® K Vf r ^> V® r ® K V® r . 
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Recall that there is a U q (g)-isomorphism S12 : V\ ®k V2 — » V2 ® Vl, for Vi = V2 = 
V", whose matrix representation is given by R12 — Rf 2 Pi2- In the notation v = 
(v\,- ■■ ,v n ) as in the proof of Proposition 2.3, this isomorphism can be described 
as 

(3.18) si 2 (vi (g) v 2 ) = v 2 <g> vii?2i, or equivalently, Si 2 (v* <g> v 2 ) = v 2 ® i?* 2 * 2 v* . 
By composing isomorphisms of this type repeatedly, we obtain an isomorphism 

(3.19) $ : (Vi <g> Vi,) <g> ■ ■ ■ <g> (V r <g> V r /) (Vi <g> • • • <g> V r ) <g> <g> • • • <g> K') 
for Vfe = Vfe/ = V (1 < fc < r); here we take 

(3.20) $ = Si' r o s 2 ' r o • • • o S( r _iv r o Si' iT -_i o • • • o S1/3 o s 2 / 3 o s 1 / 2 . 

Note that the element (wj) 8r in (V ®k F)® r is a B 9 -fixed vector, since 6 g is a 
coidcal. By this isomorphism (3.20), the t^-fixed vector (wj)® r is transformed into 

(3.21) $(wj <g> • • • <g> w,,) = $((vi Ji <g> vi) <g> ■ ■ ■ <g> (v r J r <g> v* )) 

= vi ® • • • ® v r Ki... r <g> Vi <g> • • • <g> v* , 

where 

(3.22) i^l-.-r = J\R\2 2 ^2-Ri3 3 -R 2 3 ' ' ' J r -lR\ r ' ' ' Rr-l,r * ^r- 

Note here that, as to the coefficients of the i?-matrix, we have 

(3-23) (<)* = (^ = M« ifi^A. 

Hence we see that, if the indices ii, ■ ■ ■ , i r are mutually distinct, then 

(3.24) {K±... r ) % y;;?^ = S njl ■ ■ ■ 5 lrjr a ll ■■■a ir . 

Denoting by pr r : V® r — > /\ q {V) the canonical projection, we now consider the 
£/q (rj)-homomorphism 

(3.25) * = (pr r ® pr r ) o $ : (V ® K y)®' - A ' (V) ® K A V)- 

Then, by (3.21) and (3.24), we get 
(3.26) 

<g> • • • <g> wj) = vi A • • • A v r i^i... r <g> v* A • • • A v* 



E, „ Vfe! A • • • A w fer <g)u fel A • • • /\v kr a kl ■ ■ -a kr 
l<fci,--- ,k r <n 



where [r] q 2 ! = (g 2 ; g 2 ) r / (1 — q 2 ) r . This shows that uv of (3.16) is a t g -fixed vector. 
Since f\ q (V) is isomorphic to V(A r ), there is a nontrivial LT 9 (g)-homomorphism 
Kqty) ®k Ag(^) — * ^(2A r ). The image of w r by this homomorphism gives a 
nonzero 6 9 -fixed vector in V{2K r ) since (uv) 2 A r 7^ 0. □ 

We remark that Lemma 3. 3. A can be proved also by chasing directly the action 
of Mfe i fe_|_i(l < k < n — 1) on w r (see Proposition 2.4). The intertwining operators 
<f> and ^ above will be used again later in the discussion of the invariant ring in 
Section 4. 
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Lemma 3.3.B. In Case (Sp), the element 

(3.27) w r = V* , „ v 2 k 1 -i A v 2kl A • • • A v 2 k r -i A v 2 k r a kl ■ ■ -a kr , 

'l<Kl<---<fer<n 

gives a t q -fixed vector in /\ q r (V). Hence, V(A 2r ) has a nonzero t q -fixed vector for 
1 < r < n. 

Proof. Note first that the projection pr 2 : V ®k V — > /\ q (V) maps the 6 9 -fixed 
vector wj of (2.13) to 

(3.28) pr 2 (wj) = (1 + g 2 )^ =1 w 2fc-i A v 2k a k = (1 + g 2 )^. 

Hence ioi is a tq-fixed vector in /\ r q (V). We now compute the r-th power of w\ in 
the g-exterior algebra /\ q {V) using the g-binomial theorem, to obtain 

(3.29) 

(wi) Ar = (V i>2fc-i A v 2k a k ) Ar 

= H? 4 ^^, „ ^, „• w 2fei-i A U2fei A • • • A «2fc r -i A v 2kr a kl ■ ■ ■ a kr 
= [r] 9 4!w r . 

Since 6 9 is a coideal, equality (3.29) shows that w r is a f 9 -fixed vector in /\ r q (V) for 
1 < r < n. □ 

In each case, we have now a system of generators of the monoid P e + , consisting 
of weights A with V(X)t ^ 0. In order to complete the proof of Theorem 3.1.(2), 
we have only to show that, for any A,/i € P + , the tensor product V(X) ®k ^(m) 
has a nonzero £ g -fixed vector, if both V(X) and do. This follows from the 

fact that there exists a nontrivial [/ 9 (g)-homomorphism F(A)%y(//) — > V^(A + /i), 
up to a scalar multiple. If w and w are nonzero 6 g -fixed vectors of V(X) and V^(/i) 
respectively, the tensor product v®w is annihilated by 6 g since t 9 is a coideal. Since 
(w ® w)\ +lx = v\ ® w M 7^ 0, the image of w <g> w in V"(A + /j.) then gives a nonzero 
? g -fixed vector. 

We have thus proved that V(X) has a nonzero 6 g -fixed vector if and only if 
A e P E + and that dim K V r (A) Eg = 1 for each A e P+. 

5.^. Passage from the left to the right. In this section, we have discussed t q - 
fixed vectors in left f/g(jj)-modules. The same argument naturally applies to right 
£/ 9 (rj)-modules. The passage from left J7 g (g)-modules to right C/ 9 (g)-modules can 
be described, functorially, by the ^-operation of U q (g) explained in Section 1.4. 

For a left U q (g)-module M, let us denote by M° the right U q (g)-modu\e obtained 
from M by regarding it as a right [7 9 (g)-module through this involution: 

(3.30) x.a — a*.x for all a e U q (g) and x e M. 

Then, for each dominant integral weight A e P + , the right ?7 g (g)-module V(X)° 
gives rise to the irreducible right U q (g)-module of highest weight A. 

We now look at the coideal t q (a) (a e (K*) n ) of U q (g). One can easily compute 
the action of the involution on the matrix M(a) = L + — J(a)S(L^) t J(a)^ 1 , by 
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using J(a) 1 = J(a x ) in Case (SO), or J(a) 1 = — q 1 J(a 1 ) in Case (Sp). In 
fact we have 

(3.31) M(a)* = -(J (a) Mia' 1 ) J (a)- 1 ) 1 , 

where the left-hand side denotes the matrix (M(a)ji )i<ij<N- Hence we have 
i q (a)* = 6 9 (a _1 ) for any a e (K*)". This implies that each £ g (a)-fixed vector in a 
left U q (g)-module M can be read as a t g (a _1 )-fixed vector in the right U q (g)-module 

§4. Quantum homogeneous spaces and zonal spherical functions. 

This section is devoted to the study of quantum analogue of the coset spaces 
G/K and K\G/K, for the closed subgroup K of G = GL(iV), corresponding to the 
Lie subalgebra t of Q = Ql(N) of (2.1). We fix the parameter a e (IK*)™ involved in 
the definition of the coideal t q (a) and set J = J(a),M = M(a),t q = t q {a). 

4-1- Quantum analogue of the homogeneous space G/K. In terms of the coideal 
t q = t q (a) (a e (K*) n ), we can study the quantum analogue of the homogeneous 
space G/K for the following closed subgroup K: 

(4.1) 

Case (SO): K = SO(n) = {g G GL(n) ; gg l = id„, det( 5 ) = 1} (N = n) 
Case (Sp): K = Sp(2n) = {g e GL(2n) ; g,J n g l = J n } (N = 2n). 

Recall that the "coordinate ring" A q (G) of the quantum general linear group 
GL g (iV) is a K-algebra with two-sided l/ g (0)-symmetry. By means of the bimodule 
structure over U q (g), we consider the K- vector subspace of t g -invariant elements in 
A q (G) under the left action of U q (g): 

(4.2) A q {G/K) := W e A q (G); t q . V = 0}. 

Thanks to the fact that t q is a coideal (Proposition 2.1), this subspace actually 
becomes K-subalgebra of A q {G). Note also that the subalgebra A q {G/K) is a 
left Aq(G)-subcomodule, hence a right J7 g (g)-submodule of A q (G). The algebra 
A q (G/K) is a K-algebra with right C/ 9 (g)-symmetry, and is regarded as the algebra 
of regular functions on the left quantum G 9 -space (G/K) q . 
Recall that A q (G) has the irreducible decomposition 

(4-3) A 9 (G)=0 A£p+ W{\), 

as a J7q(g)-bimodule. Here W{\) is the K-subspace of A q (G) spanned by the matrix 
elements of the irreducible right J 4 (J (G)-comodule V(X). Note also that the U q (g)- 
bimodule W(\) is isomorphic to the tensor product of Hornby, K), regarded as 
a right C/ 9 (g)-module, and the left t/«j(g)-modulc V(X). We denote by V(X)° the 
irreducible right U q (g)-module with highest weight A, so that W(X) V(X)° ®k 
V(X). From the irreducible decomposition (4.3) and Theorem 3.1, we obtain the 
multiplicity free decomposition of the invariant ring A q (G/K). 



Macdonald polynomials on quantum homogeneous spaces 



19 



Proposition 4.1. The K-subalgebra A q (G / K) of left t q -invariants in A q (G) de- 
composes into the form 

(4-4) A q (G/K) ^0 AeP(+ y(A)° 

as a right U q (g) -module. 

Proof. For each dominant integral weight A e P + , we have W{\) V{\) ®^V{\) 
as a [/ g (g)-bimodule. Hence W{\)t q V(A)° <8>k V(\)t q as a right [/ g (g)-modulc. 
On the other hand, we know that diniK V(X)i q = 1 if A g P^ and V(X)t q = 
otherwise, from Theorem 3.1. Hence we have the multiplicity free decomposition 

(4.4) by the irreducible decomposition (4.3) of A q {G). □ 

For the description of the invariant ring A q (G/K), we define a family of quadratic 
elements Xij (1 < i,j < N) in A q (G) by the formula 

(4.5) X = (x«)i<ij<iv, X = TJT\ 
These elements are explicitly written as 

(4.6. a) = ^2 t ik t jk a k (1 <i,j < n) 

in Case (SO) and 

En 
{U,2k-itj,2k - qU,2ktj,2k-i)ak (1 < i, j < 2n) 

in Case (Sp). 

Lemma 4.2. XTie elements x^ g -A g (G) defined as above are invariant under the 
left action of the coideal t q . Namely, x^ G A q {G/K) for all 1 < i,j < N. 

Proof. Note that from (1.21) we have 

(4.7) L+.T 2 =T 2 R+ 2 , S(L-)\.T 2 =T 2 R+ 2 t \ 

since (-R^) -1 = ^21 an d ^21** = ^12^ ■ Hence we have 

(4.8) L\ .X 2 = h\ .T 2 J 2 L\ .T 2 = T 2 Rf 2 J 2 Rf 2 2 T 2 



S{L-)\.X 2 = S(L-)\.T 2 J 2 S(L-)\.Tl = T 2 R+ 2 2 J 2 R+ 2 T; 
Since the matrix J satisfies the reflection equation (2.7), we have 
(4.9) (L+J 1 -J 1 S(L-)\).X 2 =0. 



This means that M\.X 2 = 0, namely t q .X = 0. □ 
As to the structure of this invariant ring, we have 
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Theorem 4.3. The K-subalgebra A q {G/K) of left t q -invariants in A q (G) is gen- 
erated by the quadratic elements x^ (1 < i, j < N) defined by (4-5), together with 
det,(T) ±1 . 

The proof of Theorem 4.3 will be given later in Section 4.4. As wc will see later, 
the square det g (T) 2 of the quantum determinant is actually represented by Xij's in 
Case (SO), and, in Case (Sp), so is det g (T) (see Remark 4.12 below). Note that, 
in each case, det q (T) lies in the center of A q (G/K). For the present, we will show 
that the commutation relations among the quadratic elements (1 < i, j < N) 
are described again by the reflection equation. 

Proposition 4.4. The elements Xij (1 < i, j < N) defined above satisfy 
(4.10) 

Case (SO) : Xij — qxji (1 < i < j < n) 

Case (Sp) : Xu = (1 < i < 2n), qxij + Xji = (1 < i < j < 2n). 
In each case, they have the commutation relations 
(4.11) X 2 R~i2 2 X\ = Xi 2 X 2 R^ 2 . 



Proof. In each case, formula (4.10) can be shown directly by using the expression 
(4.6) and the commutation relations (1.3) of the "coordinates" Uj . We show that the 
matrix X satisfies the reflection equation (4.11). Note that commutation relations 
(1.4) for T implies 

(A 1 9\ T 1 ^ £?+ ^ 2 T + ^ rpt rp T->+ ^ 2 rpt rpt 7~>+ ^2 rp rptrpt rptrpt o+ 

(i.iZ) 1 2 K 12 J l — J l- K l2 J 2; J 2-Ki2 J i— J i-Ki2 J 2, n. 12 l 2 1 1 — 1 1 1 2 H 12 . 

(Note that R+ 2 * = and i?+ * 2 = R^ 1 .) By using (1.4), (4.12) and the reflection 
equation for J, we obtain 

(4-13) 

R^ 2 X 2 R^ 2 X\ = R^ 2 T 2 J 2 T 2 R^ 2 TiJ\T^ — Ri 2 T 2 J 2 TiR J [ 2 T 2 J\T?[ 
= Rf 2 T 2 TiJ 2 Rf 2 2 J\T 2 T\ — T\T 2 R J [ 2 J 2 R J [ 2 2 JiT 2 T^ 

T T J D+ ^ 2 T D+ rptrpt rp rp j r>+ * 2 T rptrpt D + 

— Ill 2 JlK 12 J 2 -tt 12 l 2 l 1 — l\l 2 J\ti l2 J 2 1 1 1 2 K 12 
= TiJiT 2 R^ 2 2 T^J 2 T 2 R^2 = Ti JiT*i?^2 2 T 2 J 2 T 2 R^ 2 
= XiRf 2 2 X 2 Ri 2 , 

as desired. □ 

This description of the invariant ring corresponds to the realization of the ho- 
mogeneous space SL(n)/SO(n) and SL(2n)/Sp(2n) as an orbit of symmetric and 
skew-symmetric matrices, respectively. The quadratic elements x^ (1 < i,j < N) 
above can be thought of as the quantum analogue of the coordinates for the space 
of symmetric or skew-symmetric matrices. 



Macdonald polynomials on quantum homogeneous spaces 



21 



Remark 4.5. By the right action of U q (g) on A q (G), we can also consider the quan- 
tum analogue of the right homogeneous space K\G. The subalgebra of right fig- 
invariants 

(4.14) A q (K\G) ~{<pe A q {G);ip.t q = 0} 

of Aq(G) is a K-algebra with left [/ g (g)-symmetry, and has the multiplicity free 
decomposition 

(4-15) A q {K\G) ^0 A£p ^(A) 

as a left C/ 9 (g)-module, similarly to (4.4). In this case we define the quadratic 
elements tjij (1 <i,j < N) by the formula 

(4.16) Y = {Vij)i<ij<N, Y = T t J- 1 T. 

For these elements tjij, we have exactly the same statement as Proposition 4.4. 
This follows from that fact that J -1 = J(a)^ 1 satisfies the same reflection equation 
(2.7); J(a) _1 is a constant multiple of J(a _1 ). The invariant ring A q (K\G) is then 
generated by the quadratic elements yij (1 < i,j < N) and det g (T) ±:L . We remark 
that all these properties of A q (K\G) are obtained from those of A q {G/K) by using 
involutions as we explained in Section 3.4. 

4-2. Quantum analogue of the double coset space K\G/K. The next step is to 
study the quantum analogue of the double coset space K\G/K. We consider the 
following K-subalgebra of tq-biinvariant elements in A q (G) : 

(4.17) H = A q (K\G/K) := {<p G A q (G); t q .tp = ipl q = 0}. 

From the irreducible decomposition (4.3) of A q {G) again, we have the direct de- 
composition of the K-subalgebra H of t g -biinvariants 

(4.18) ^ = AeP+ ^( A )> withW(A) =HDW(X). 

We remark that diniKH(A) = 1 if A e and H(X) = otherwise, as is imme- 
diately seen from Theorem 3.1 and its right U q (g)-module version. We say that a 
nonzero element if of H{\) (A E P+) is a zonal spherical function associated with 
the representation V(X). Recall that the subspace W{\) of matrix elements of the 
right A g (G)-comodule V{\) is characterized as the simultaneous eigenspace of the 
center of U q (g): 

(4.19) W{\) = {ip e A q (G); C.ip = x\{C)<p for any central C e U q (g)}, 

where Xa(C) denotes the eigenvalue of the central element C G U q (g) on the irre- 
ducible representation V(A). From this, we see that a nonzero element <p € A q {G) 
is a zonal spherical function associated with V(A) if and only if 

(1) t q .ip = ip.tq = 0, and 

(2) C.ip — x\{C)<£ for any central element C G U q (g). 
Summarizing these remarks, we have 
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Proposition 4.6. The subalgebra Ti = A q (K\G/K) of t q -biinvariant elements in 
A q (G) has the simultaneous eigenspace decomposition Ti = (§)x e p+Ti(\) under the 
action of the center ofU q (g). Furthermore, the simultaneous eigenspace Ti(X) is 
one- dimensional for each A e 

For the description of the zonal spherical functions ip, we consider their "restric- 
tion" ip\j to the diagonal subgroup T = (K*)^ of the quantum group GL q {N). Re- 
call that the quantum general linear group G~L q {N) "contains" the iV-dimensional 
algebraic torus T = (IK*)^ on its diagonal. Let z = (z\, • • • , zn) be the canonical 
coordinates of T; the coordinate ring A(T) is the K-algebra of Laurent polynomials 
K^ 1 ] = K[^i ±1 , • • • , zn ±x ]. Then there exists a unique Hopf algebra homomor- 
phism p> i ► c^|t : A q (G) — > A(T) such that tij\j = SijZj for 1 < i, j < N. 

The restriction of £ 9 -biinvariant "functions" on GL q (N) to the diagonal subgroup 
T is described by the composition of K-algebra homomorphisms 

(4.20) Ti = A q (K\G/K) ^ A q (G) -» A(T). 

Theorem 4.7. The restriction mapping Ti = A q (K\G / K) — > A(T) is an infec- 
tive WL-algebra homomorphism; hence, Ti. is a commutative ¥L-subalgebra of A q (G). 
Furthermore the image TL\j ofH is given by 

(4.21) 

Case (SO): H\t = K[zi 2 , • • • , z n 2 f n [(«i ■ ■ ■ z n y l ] 
Case (Sp): U\t = K[z\z 2 , - ■ ■ , z 2n -iz 2n } en \{z x z 2 ■ ■ ■ z 2n )~ 1 ]. 



The proof of Theorem 4.7 will be given in Section 4.5. Theorem 4.7 for Case 
(SO) is stated also in [UT]. 

4-3. t q -invariant matrix elements. In order to investigate the invariant rings 
A q {G/K) and A q {K\G/K), we study the t 9 -invariance of matrix elements of irre- 
ducible representations V(X). For this purpose, we will make use of the unitariz- 
ability of yl 9 (G)-comodules, with respect to the Hopf *-algebra structure of A q (G) 
explained in Section 1.4. In our setting K = Q(q), we take the conjugation on K to 
be the identity mapping, which means that q is "real" . 

Let M be an arbitrary finite dimensional right A g (G)-comodulc M, and pq : 
M — > M ®k A q (G) its right coaction. We use the subscript G for the coaction to 
remember that this structure corresponds to a group representation. It is known 
that there exists a nondegenerate hermitian form ( , ) : M x M — > K, conjugate 
linear in the first argument, which is invariant with respect to the quantum unitary 
group \J q (N) in the sense 

(4.22) (pg( u ), Pg( v )) = (u,v).l for any u, v g M. 

Here, we use the same notation ( , ) to refer to the hermitian form (M ®^A q (G)) x 
(M ®k A q (G)) -> A q (G), naturally defined on M <X>k A q (G); namely, 



(4.23) 



(u <g> ip, v ® ip) = (u, v}(p*ip g A q (G), 
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for u, v E M and ip, ip E A q (G). Furthermore, ( , ) can be chosen so that it should 
be positive definite when q is specialized to a real number with \q\ ^ 0, 1; then one 
has (u, u) ^ for any nonzero vector u E M. As to the left J7 9 (fl)-module structure 
of M, the U 9 (7V)-invariance of ( , ) implies 

(4.24) (u,a.v) = (a*.u,v) for u,v E M and a E U q ($), 

under the *-operation of U q (g) (see Section 1.4). Note that, if M is irreducible, a 
U 9 (./V)-invariant hcrmitian form is determined uniquely up to a scalar multiple. 

Fixing a hermitian form on M as above, we define the matrix element 4>m{u, v) E 
A q (G) of M associated with a pair (u,v) of elements in M by 

(4.25) <j> M (u, v) := («, p G (v)) E A q (G). 

By the U 9 (iV)-invariance of the hermitian form, one can easily show 
Lemma 4.8. (1) <Pm(v,u) — t((/)m(u, v)) for all u,v E M . 

(2) a.(f>M(u,v) — (pM(u,a.v) and tf>M(u,v).a = 4>m(o* .u,v) for all u,v E M and 
aEU q (e). 

When M = V(X) (A E P + ), we will write (f)\(u,v) — (f>v(\)( u , v ) f° r short. 
Denoting V(X)° the right U q (g)-module obtained from V(X), we can regard the 
hermitian form ( , ) as a K-bilinear form V(X)° x V(X) — > IK. Accordingly, the 
mapping (u,v) i— > cp\(u,v) give rise to a J7 g (g)-bimodule homomorphism 

(4.26) (f>\ : V(X)° ® K V(X) -> A q (G), 

and its image coincide with the subspace W(X) of matrix elements of A q (G). This 
gives a description of the isomorphism V^(A)° ® V"(A) W(X). 

We fix a highest weight vector m(A) in V(X). We now assume that A E P { + and 
denote by w(X) the 6 9 -fixed vector in V(X) normalized so that the highest weight 
component of w(X) should give u(X); this normalization makes sense by Lemma 
3.2. Recalling that t q = t q {a) implies t q * = {^(a -1 ), we also take the B 9 *-fixed 
vector w*{X) in V(X) such that w*{X)\ = u(X). By using these vectors, we define 
the matrix elements <po(A) and ip(X) by 

(4.27) po(A) = 0a(«(A), w(X))/(u(X), u(A)), 

v(A) = <p\(w*(X), w(X))/ (u(X), u(X)) 

Lemma 4.9. Let X = J2k=i ^k e k be an element o/P { + . 

(1) The matrix element </?o(A) gives a highest weight vector of the right U q (g) -module 
W-^A)^. Furthermore, its restriction to the diagonal subgroup T is given by 

(4.28) ^ (A)|t = ^ = ^i Ai ---^ An . 

(2) The matrix element ip(X) gives a £ q -biinvariant element in W(X), i.e., <p(A) E 
TL{X). Furthermore, its restriction to the diagonal subgroup T is a homogeneous 
polynomial in the form 



(4.29) ¥>(A)| T - z x a^z" (a^EK), 
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where < denotes the dominance order of weights in P. 

Proof. From Lemma 4.8, it follows directly that (fio(X) is a highest weight vector of 
W(\)t q and that f(X) is a tq-biinvariant element in W(\). Setting uo = u(X), take 
a basis {u , u\, ■ ■ ■ , u m } for V(\), consisting of weight vectors Uj of weight so 
that p^ = A. Note that (u , Uj) = for j = 1, • • • , m. Write the vectors w(X) and 
w*(A) in the form 

(4.30) w(\) = u + fiUj, 

w* (X) = uq + . ^djUj, 

where Cj, dj € K. Note that the restriction of <£o(A) and (p(X) to T can be written 
as follows by using the coaction pj : V(X) — > V(X) <8>k A(T) : 

(4.31) <p (\)\ T - (u(X), PT (w(X)))/(u(X), u(A)>, 

¥>(A)| T - K(A),p T ( W (A)))/( u (A), u (A)). 

Since Pt(w(A)) = Y^jLo c j u j ® > we compute 

(4.32) («(A),u(A)) ¥ )o(A)|t = X!" c J («(A),^)z^ (3) = («(A), «(A))z A . 

Similarly, we have 
(4.33) 

( u (A), W (A))^A)| T = ^ m Cj -K(A), Uj -)^ W) 

= ( U (A), «(A))z a + £™ iC ,>*(A), Uj >s" W) , 

as desired. □ 

For the proof of Theorem 4.3 and Theorem 4.7, we need to determine the explicit 
form of (fio(X) and ip(X) for the fundamental weights A in P { + . Let 1 < i\ < i 2 < 
■ ■ ■ < i r < N and 1 < j\ < ji < ■ ■ ■ < j r < N be two increasing sequence of 
indices of length r (1 < r < N). Then we denote by C,\..?j T the quantum minor 
determinant of the matrix T = {tij)i<i,j<N, with row indices i\, ■ ■ ■ ,i r and column 
indices j u ■ ■ ■ ,j r : 

(4-34) Zjl-jl = 5Z t(je6r ( _< ?) £( "'-'ii ro(1 )il^ ro(2) i2 ' ■■~ t i w ( r) jr- 

When (ii,z 2 ,--- , v) = (1>2, ■■■ , r), we write £,j 1 ---j r — Cji'.-X f° r short. It is 
known that the fundamental representation V(A r ) = Ag(^0 nas a U g (iV)-mvariant 
hermitian form such that the basis {vj 1 A • • • A Vj r }i<j 1 <---<j r <N is an orthonormal 
basis (see [NYM]). Under this hermitian form, we have 

(4-35) C^:X = <i>A r {vn A • • • A v ir ,v h A • • • A v jr ), 

for i\ < ■ ■ ■ < i r and ji < ■ ■ ■ < j r - 
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Lemma 4. 10. A. In Case (SO), the matrix elements ipo(2A r ) and <p(2A r ) are de- 
termined as follows: 

(4-36) 

z — Oi<-"<> 

^) = E il< ... <ir;jl< ... <j ;^:::};) 2 ^ 1 ---^ 1 ^---^- 

Furthermore, for any I € Z, we /iaue y>o(^A„) = <p(£A n ) = det q (T) e . 

Proof. It is directly checked that the J 9 -nxed vector uv of Lemma 3. 3. A lies in 
the C/ 9 (g)-submodule of /\ r q (V) ®k /\ q (V), generated by the highest weight vector 
V\A- ■ -Av r <giViA- ■ -Av r . In fact, each summand v kl A-- ^1)^®% A- • • A«fc r of uv is 
obtained from v\ A • • • Av r ®v\ A ■ ■ ■ Av r by applying the elements fj (1 < j < n—1) 
repeatedly. Hence, we can compute the matrix elements <y9o(2A r ) and <p(2A r ) by 
means of the f^-fixed vector in /\ q (V) ®k /\ q (V). Setting w(2A r ) = v\ A ■ ■ ■ A v r <g> 
v\ A ■ ■ ■ A v r , we have 

(4.37) 

w(2A r ) = a^ 1 ■ ■ ■ a~ 1 w r 

= < <k v kl A • • • A v kr <g> v kl A • • • A Wfe^a^ 1 • • ■a~ 1 a kl ■ ■ -a kr , 
w*(2A r ) = V\ v ki A ■ ■ ■ A v kr ® v kl A ■ ■ ■ A v kr ai ■ ■ ■ a r a^ ■ ■ ■ a^ 1 . 

This implies 
(4.38) 

ai ■ ■ ■ a r p G (w(2A r )) = p G (w r ) 

= X, :; ,/< A ■ ■ ■ A Vi r ® Vj x A ■ ■ ■ A v jr 

»E kI< .,^ : ^t*-»v 

Hence, under the induced hermitian form on /\ q (V) ®k /\ q (V), we compute 
(4.39) </>2A r (M(2A r ),u;(2A r )) = V (^...^fa^ 1 ■ ■ ■ a^a^ ■ ■ ■ a kr , 

and 



(4.40) cj) 2K {w*{2A r ),w{2A r )) 

^ii<-<i r ;ji<-<jr 31 Jr 1 r 

The last statement of Lemma is clear since V(£A n ) is one dimensional and its matrix 
element is given by det g (T) £ . □ 



26 



MASATOSHI NOUMI 



-i,2ji,-,2j r -i,2j r ai 1 • • -a r 1 a n ■ ■ -a jr , 

t 2»i-l,2»i,-" ,2i r -l,2» r -1 -1 
2ji-l,2ji,-,2j r -l,2j r a ii -a v °ii ' ' -a >- 



Lemma 4.10.B. In Case (Sp), the matrix elements (pa(A 2r ) and if(A 2r ) are de- 
termined as follows: 
(4.41) 

W)(A2r) = E 1 < J - 1< ... <jp <>i 

<^(A 2r ) = V £ 

v ' ^— 'l<»i< — <i r <n;l<ji< — <j r <n 

Furthermore, for any 16 Z, we /icwe <po(^A2 ra ) = ip(lA2 n ) = det 5 (T)^. 

Proof. As to /\ q r (V), we can ta kc 
(4.42) 

M(A 2r ) = Ul A U 2 A • • • A V 2r , 

w(A 2r ) = a^ 1 • • • a~ 1 w r 

= ^2 u 2fc!-i A v 2kl A • • • A v 2 k r -i A v 2 k r a^ 1 ■ ■ -a~ l a kl ■ ■ -a kr , 

l<ki<---<k r <n 

w*(A 2r )= ^2 v 2kl -i A v 2kl A ••• A v 2kr -i A v 2kr ai ■■ ■ a r a^ 

l<k 1 <---<k r <n 

Then we have 
(4.43) 

a\ ■ ■ ■ a r p G {w(K 2r )) = p G {w r ) 

= V . . A v l2 A • • • A v l2r 

* <11<12<---<12t 

® Sl<fe 1 <...<fe t .<„^W-l,2fe 1 , 82 r,2fe t .-l,2fe r a fei 

With the vectors in (4.42), we can easily see that the elements 0A 2r ( u (A2r), w(A 2r )) 
and 0A 2r ( w *(A2r), w(A 2r )) are written in the form (4.41). □ 

4-4- Proof of Theorem 4-3. We now prove that the quadratic elements Sy (1 < 
i,3 < N) and det g (T) ±1 generate the invariant ring A q (G/K). For this purpose, 
we look at the highest weight vectors in A q (G/K). Consider the subalgebra 

(4.44) A q (N\G/K) = e A q (G/K); v .n q = 0} 

of highest weight vectors in A q (G/K), where n q denotes the coideal of U q (g) spanned 
by L^j (i < j), corresponding to the nilpotent Lie subalgebra of lower triangular 
matrices. By the irreducible decomposition of Proposition 4.1, we see that the 
matrix elements </?o(A) (A e P { + ) form a K-basis for A q (N\G/K): 

(4.45) A q (N\G/K) = ©^K^A). 

Then by Lemma 4.9.(1), we see that this algebra is isomorphic to the following 
subalgebra of A(T) — K^ 1 }, through the restriction mapping A q (N\G / K) — ► 
A(T): 

(4.46) A q (N\G/K)\ T = Q^KzK 

This implies: 
(4.47) 

Case (SO): A q (N\G/K)\ T = K[z 2A \z 2A \- ■ ■ , z 2An ~\ z ±An ], 

Case (Sp): A q {N\G/K)\ T = K[z A \ z A \ ■ ■ ■ , z A *<— n , z ±A2 "}. 
Hence we have 



■a kr . 
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Lemma 4.11. The algebra A q (N\G / K) is a commutative K-algebra generated by 
the following matrix elements: 

(4.48) Case (SO): ip Q (2A r ) (1 < r < n - 1), det 9 (T) ±1 , 

Case (Sp): ^ (A 2r ) (1 < r < n - 1), dct 9 (T) ±1 . 



Note that the algebra A q (G/K) is generated by the subalgcbra A q (N\G/K) 
as a right C/ 9 (g)-module. Hence, in order to prove that the quadratic elements 
Xij (1 < i, j < N) and det (J (r) ±1 generate the algebra A q (G/K), we have only to 
show that the generators of A q (N\G / K) above are actually contained in the algebra 
K[xij (1 < i,j < N), det 9 (T) ± ]. It should be noted that the quadratic elements 
from the coaction of A q (G) at the ^-invariant element wj e V ®k V of 
Proposition 2.3: 

(4.49) PG (wj) = Y,^^ ® v i ® Si< fc ,/< JV ** fcjMt ^ 

= Ei< iJ < JV t,< ® ^' ® 

Case (SO): We show that the matrix elements i^o(2A r ) (1 < r < n) are contained in 
the subalgebra K[xij (1 < i,j < n)] of A q (G/K). We make use of the intertwining 
operators $ : {V ® K V)® r ^ V® r ® K V® r and * : {V® K V)® r -> A q (V)® K A q (V) 
as in the proof of Lemma 3. 3. A. We take the following matrix representation of <f>: 

(4.50) 3>(vi <g> vi' ® • • • ® v r <g> v r /) = vi <£> • • • <g> v r <g> vi' ® • • • ® v r <$i... r;:L /... r <, 
where 

(4.51) $i... r; i/... r / = • • ■Rj( r _ 1 y ■ ■ ■ R^R^Rzy- 

Then we have 
(4.52) 



* '/il<"'</i r ;i / l<---<^r 



»!••■ VJl" Jr ' 



where the matrix coefficients of ^ are given by 

(4 53) jjyMl-Mrjfl"-^ _ C_„^(o-)+^(T)^^(l)'-'^(r)^r(l)'-^T(r) 

Since ^ is a homomorphism of right A g (G)-comodules, the equality ^{wj® r ) = 
[r] q 2\w r in (3.26) implies 

(4.54) *{ PG {wY)) = [r] q A PG {w r ). 

As the right-hand side is already given in (4.38), we now compute the left-hand 
side of (4.54) explicitly. From p G (wj) = -Uj <g> Vj <g> we have 

(4.55) p G {w.j® r ) = v i ^<S)V^<g)---<%)Vi r <g)Vj r <g)Xi 1 j 1 ---Xi r .j r . 

* '»l,-"»ryii- Jr 
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Hence we have 
(4.56) 

*(p G (t«? r )) = , , <r <r "Mi A - A V®^A'-A\ 



by (4.52). Comparing this formula with (4.38), we obtain 
(4.57) ^i 2] J2 kl< ... <kr ^ 1 -k r ) 2 a kl ■■■a kr 

= E * 



1 ■■■r;l •■■ r 

ii---i r ;ji---jr Xil ^ 1 " ' x i 



which gives an expression of <^o(2A r ) in terms of Xij (1 < i,j < n). This completes 
the proof of Theorem 4.3 for Case (SO). 

Case (Sp): We show that the matrix elements </9o(^2r) 0- < r < n) are contained 
in the subalgebra K[xij (1 < i, j < 2n)\ of A q (G/K). With the notation of Lemma 
3.3.B, we consider the t 9 -fixed vector w r in /\ r q (V). From (4.49), we obtain 

(4.58) Pg(wi) = Y\^ _ ^Aw 3 ®Xy. 

Since the coaction : A 9 (^0 — * A 9 (^0 ®k ^?(G) is an algebra homomorphism, 
we have 

(4.59) p G (wi Ar ) = A Vj t A • • • A v ir Av jr <g> x ixix ■ ■ -x irir . 

*■ — '»i<ji;-- !*r<Jr 

On the other hand, we know that w^ r = [r] q *\w r ; hence equality (4.59) gives a 
formula for [r] q 4 \pc(w r ). Comparing this with (4.43), we have 

(4.60) 

H,i!) ^ , ^2fei-l,2fei,-,2fe r -l,2fc r afei • • • ak r 

*■ — 'fcl<-"<fc r 

= E cfi , , v ln A~lY^ x w(l)w{2) ■ ■ ■ %w(2r-l)w(2r)- 

L — 'wE&2r'w{l)<w{2j;--- •w{2r — l)<w(2r) ' v ' v ' ' 

This gives the expression of i/?o(A 2r ) in terms of x^j (1 < i, j < 2n). This completes 
the proof of Theorem 4.3 for Case (Sp). 

Remark 4.12. In Case (Sp), (4.60) contains the following formula for the quantum 
determinant det g (T): 

(4.61) 

[n] q i\det q (T)ai ■ ■ -a n 

= E^ eS2 „ :u;(1)< ,„ (2) ,.. ;w(2n _ 1)<t „ (2 „ ) (-9) £(u ' ) ^(i)« ) (2) • ■■x w{2n - 1)w(2n) , 

which can be regarded as the "quantum Pfafhan" of the g-skew-symmetric matrix 
X = TJT 1 . In Case (SO), (4.57) implies a formula representing the square det 9 (T) 2 
of the quantum determinant in terms of the matrix elements of X = TJT*. We do 
not know, however, whether (4.57) reduces to a simple formula, even in the case 
when r = n. 
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4-5. Proof of Theorem ^.7. By Lemma 4.9.(2), we see that the zonal spherical 
functions (p(X) (A e form a K-basis of the subalgebra H = A q (K\G/K) of t q - 
biinvariant elements. Furthermore, the restriction of ip(X) to the diagonal subgroup 
T has the leading term z x under the lexicographic order of the monomials in ^4(T) = 
K[z ±1 ]. This shows that the restriction mapping H = A q (K\G/K) -> A(T) is 
injective. 

From Lemma 4. 10. A, it follows that 
(4.62.a) y(2A r )| T = e r (^,--- (1 < r < n) 

in Case (SO). Here we denoted by e r (x\, • • • , x n ) the elementary symmetric function 
of degree r in the variables (xi, ■ ■ ■ ,x n ). Similarly, from Lemma 4.10.B it follows 
that 

(4.62.b) <^(A 2r )| T = e r (z 1 z 2 , ■ ■ ■ ,z 2n -iz 2n ) (1 < r < n), 

in Case (Sp). Note also that 

(4.63) i fi {lk N )\ 1 = det q (T)% = {z 1 z 2 ---z N y 

in each case. Hence the statement concerning the image TC\t in Theorem 4.7 is 
equivalent to the following lemma. 

Lemma 4.13. The algebra H = A q {K\G/K) of t q -biinvariants is generated by 
the following matrix elements: 

(4.64) Case (SO): </?(2A r ) (1 < r < n - 1), det^T)* 1 
Case (Sp): (p(A 2r ) (1 < r < n - 1), det^T)* 1 



Proof. Recall that the "coordinate ring" A q (M&t(N)) of the quantum matrix space 
Mat g (A) has the following irreducible decomposition as a [/,j(g)-bimodule: 

(4.65) A q (M&t(N)) = Aep+nL H/(A), 

where L = {A e P; (A, e^) > (1 < r < N)} denotes the first quadrant of the 
weight lattice P. Let us denote by H>q = A q (K\Ma,t(N) / K) the the subalgebra 
of all t g -biinvariants in yl 9 (Mat(A r )). Then from the decomposition (4.65) we have 

(4.66) H> = A£Pe+nL K^(A) 
just as in the case of H. It is clear that 

(4.67) </?(A)det 9 (T) £ = tp(\ + £A N ) for any A e P+, £ e Z. 

Hence we have only to prove that H.>o is generated by the following matrix elements: 

(4.68) Case (SO): p(2A r ) (1 < r < n - 1), dct 9 (T), 
Case (Sp): <p(A 2r ) (1 < r < n). 
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Recall that any A e P^ n L can be written in the form 

En— 1 
2m r K r + £A n 
r—l 

En 
m r A 2r 
r— 1 

for some m r e N (1 < r < n) and leN. In view of (4.69), we define the element 
<p(X) in H> by 

(4.70) Case (SO): £(A) - ^AO™ 1 • • • ^(2A„_ 1 ) m - V(A„) £ 

Case (Sp): £(A) = <p(A 2 ) mi ■ ■ ■ ^(A 2 „) m ". 

Note that, under the lexicographic order ^ of L, the polynomials <^(A)|t and £>(A)|t 
in K[z] have the common leading term z x . From this fact, one can easily show that 
H>o is generated by the elements in (4.68), by the induction with respect to the 
well-ordering ^ of L. If p is a nonzero elements in H>o, its restriction ip\j has 
the leading term cz M for some \i € P { + n L and c e IK by (4.66). By the induction 
hypothesis, the element tp = p — cp(pi) is expressed as a linear combination of 
elements in (4.70), since ip has the leading exponent strictly less than \x under <. 
Hence if = ip + cp(fi) also lies in the subalgebra of 7i>o generated by the elements 
in (4.68). □ 

This completes the proof of Theorem 4.7. 

Remark 4.14. As we have seen in the proof of Lemma 4.13, we have 

(4.71.b) K^(A)| T = K[z 1 z 2 ,... ,z 2 „_ 1 z 2 „] e " 

in Case (Sp). In Case (SO), we have 

(4.71.a) AgPe+n2 jMA)lT = K[z?... ,z 2 n f". 

To show (4. 71. a), we have to prove that, if A e P { + n 2L, then </?(A)|t belongs to the 
algebra K[zf • • • , z ? 2 J. If A e P^ n 2L, we can set I — 2m n in (4.69) and we have 

(4.72) p (X) = ¥> (2Ai) mi • • • p (2A n ) m " 

By Lemma 4. 10. A, it is clear that, in the weight decomposition of <po(2A r ), nonzero 
components occurs only for the weights in 2L, for any 1 < r < n. Accordingly, 
Po{\) also has the same property by (4.72). In view of (4.33), we conclude that 
¥>(A)|t lies in K[zf ■ ■ ■ ,z%\ as desired. 

§5. Macdonald's symmetric polynomials as zonal spherical functions. 

In this section we investigate the restriction of the zonal spherical functions 
p(X) (A e P { + ) to the diagonal subgroup T of GL q (N). They are expressed by 
Macdonald's symmetric polynomials P t _ l (x:q,t) in n variables with a special value 
of (q,t). This result will be established by computing the radial component of a 
central element of U q (g). 
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5.1. Macdonald's symmetric polynomials. We begin with a recall on Macdonald's 
symmetric polynomials ([M2, M3]). Macdonald's symmetric polynomials P^x; q, t) = 
Pfj,(xi,--- ,x n ;q,t) are a family of symmetric polynomials in Q(q, t)[x\, ■ ■ ■ ,x n ], 
homogeneous of degree Y^k=i Mfc? parametrized by partitions fi = (fii, ■ ■ ■ ,ji n ) G 
N n (mi > •• • > M„ > 0). Among many characterizations of P t _ l (x; q,t), we recall 
now the following two properties. 

i) For each fi, the polynomial P^(x;q 7 t) has an expression 

(5.1) P^{x;q,t) = m^{x) + ^ c ^ m ^( x ) (<V e Q(l,t)), 

where m^(x) stands for the monomial symmetric function of monomial type \i and 
the symbol < denotes the dominance order of partitions. 

ii) For each /i, P^x^q, t) satisfies the g-difference equation 

(5-2) £ A{Xl ^; ,tXk, ''\ ,Xn) T g , Xk P,(x; q, t) = (£ t»" VWta 9, *), 
k=i ^{x 1 ,---,x n ) fc=i 

where A(xi, • • • , x n ) stands for the difference product 

(5.3) A(xi, • • • ,x n ) = Y\ ( x j- x i) 

l<i<j<n 

and A(xi, • • • , txk, ••• , x n ) for A(x\, ■ ■ ■ , x n ) with Xk replaced by txk- The symbol 
T q , Xk denotes the g-shift operator in Xk defined by 

(5.4) { T q,x k f){xi, ■■■ ,x n ) = f(x lt ■ ■ ■ ,qx k , ■ ■ ■ ,x n ). 

We remark that property i) implies that the symmetric polynomials P ti (x;q 7 t) 
form a Q(q, i)-basis for the algebra Q(q, t)[x] 6n , as fj, runs over the set of all parti- 
tions in N". This means that the g-difference operator in the left-hand side of (5.2) 
is diagonalizable on Q(q, t)[x] 6n and that its eigenspaces are all one-dimensional. 
Note that the coefficients of the g-difference operator are also written in the form 

A(X X , ■ ■ ■ ,tx k , ■ ■ ■ ,X n ) _ -pr tx k - Xj 

A(xi, ■ ■ ■ ,x n ) <. l[ :j . L : ' 

Returning to the setting of Section 4, we consider the zonal spherical function 
(p(X) associated with the representation V(X) (A e P^)- For the description of 
ip{\)\f, we use the following parametrization of A by partitions /i: 



(5.6) Case (SO): A = £ 2 Mfc£fc + M n , 

fc=i 

n 

Case (Sp): A = J~] /ifc(e 2 fc-i + £2fc) + lA 2n , 
k=i 

where fi = (/ii, ■ ■ ■ , fJL n ) stands for a partition in N" and I e Z. 
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Theorem 5.1. For each X G P E + , the restriction of the zonal spherical function 
ip(\) to the diagonal subgroup T is expressed in terms of Macdonald's symmetric 
polynomial P^. To be more precise, we have 

(5.7) 

Case (SO): p(A)| T - P^l ■ ■ ■ , z 2 n ; q\ q 2 ){ Zl ■ ■ ■ z n f, 
Case (Sp): <^(A)| T = P t ,(z 1 z 2 , • • • , z 2n -\Z 2n \ q 2 ,q i )(z 1 z 2 ■ ■ ■ z 2n f , 

under the parametrization of X as in (5.6). 

For the identification of c^>(A) |t with Macdonald's symmetric polynomial P M , we 
will show that ^j(A)|t satisfies a g-diffcrence equation corresponding to (5.2). Such 
a g-differcncc equation arises as the radial component of a central element of U q (o). 

5.2. Radial component of a central element in U q (g). Let C be a central element 
of U q (o). Then its action on A q (G) preserves the subalgebra H = A q (K\G/K). 
Hence, the action of C on TL induces a K- linear operator on its image 7i\f by 
the restriction H — > A(T). This operator acting on H\t will be called the radial 
component of C and denoted by C\j. Note that, since C is central, the two actions 
of C on A q (G), one from the left and the other from the right, eventually coincide. 
In what follows, we define the elements Xi, ■ ■ ■ ,x n in A(T) = K[z ±1 ] by 

(5.8) Case (SO): xi — z 2 , ■ ■ ■ , x n — z 2 , 

Case (Sp): x x = z x z 2 , ■ ■■ ,x n = z 2n -\z 2n . 

With these elements, the image W|t is written as 

(5.9) Case (SO): H\ T = K[*i, • • • , x n ] & - [( Zl ■ ■ ■ z n )-% 
Case (Sp): H\ T = K[si, ■ ■ ■ , £„] S " [(a* ■ ■ • a^)" 1 ]. 

We now recall on the central elements C r (r = 1, 2, • • • ) of U q (g) proposed by 
[RTF]. They are defined as 

(5.10) C r =tT q ((L+S(L-)) r ), 
where we use the notation of g-trace 

N 

(5.11) tv q (A) = J2l 2{N ~ k) akk, 

fe=i 

for a matrix A = (aij)i<i,j<jv in EndK(V) <8>k U q (g). Note that the central element 
C\ takes the form 

(5-12) C,= ]T f^LpiLj,). 

l<iJ<N 

Its eigenvalue on the irreducible representation V(X) is given by 

N N 

(5.13) xx(Ci) = J2q 2(ek - X+p) =J2<l 2{Xk+N - k) , 

k=l fe=l 

where p = Y,k=i( N ~ k ) e k- 
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Theorem 5.2. On the subalgebra K[xi, • • • , x n ] 6n ofH\t, the radial component of 
the central element C\ G U q (g) above is given by the following q-difference operator 

(5.14) 

Case (SO): D 1 
Case (Sp): D\ 



It is easy to show that Theorem 5.2 implies Theorem 5.1. From (4.67), it is clear 
that 

(5.15) ip(X + £A N )\ T = ip(X)\ T {z! ■ ■ ■ z N ) 1 

for any I G Z. Hence, we may assume that I = in the parametrization of (5.6). 
When £ = 0, the restriction ip(X) |t lies in the algebra K[xi, • • • , x n ] as we mentioned 
in Remark 4.14. Note also that, under the parametrization of (5.6), the eigenvalue 
Xa(Ci) is written as 

n 

(5.16) Case (SO): X x(Ci) = ]T q 2 ^~ k \^ , 

fe=i 

n 

Case (Sp): X a(Ci) = (1 + q 2 ) ^ q^^q 2 ^ . 

fe=i 

Since ^>(A) satisfies the equation (Ci — xa(Ci)) ( ^(A) = 0, its restriction </?(A)|t 
satisfies the g-difference equation 



E 



A(xi, ■ ■ ■ ,q 2 x k , ■ ■ ■ ,x n ) , 

A(xi, • • • ,X n ) 



/i i 2\ A(xi, • • • , q 4 Xk, ■ ■ ■ ,X n ) 

(i + q ) 2^ — ; 



fc=l 



A(xi, • • • ,x„) 



(5.17) (£>! - xa(Ci)MA)| t = 0. 

By Theorem 5.2 and (5.16), we see that (5.17) gives rise to the g-difference equation 
(5.2) with (q, t) replaced by (<? 4 , q 2 ) in Case (SO), and by (q 2 ,q 4 ) in Case (Sp). This 
(/-difference equation determines <p(\) up to a scalar multiple since the mapping 
fi i— > Xa(Ci) is still injective after the specialization of (q, t). Noting that v(A)|t and 
the corresponding P M has the common leading term z A = x M , we obtain Theorem 
5.1 for the case where I = 0. 

We remark that this argument is also valid in the setting where K = C and q 
is a real number with \q\ ^ 0,1, as the partitions fj, are separated by the values of 
Xx(Ci). 

5.3. How to compute the radial component C\j. Before the proof of Theorem 
5.2, we explain how we are going to compute the radial component C\j of a central 
element C of U q (g). Our method is based on the duality between A q (G) and U q (g); 
its spirit is the same as that of Koornwinder [K2] . 

Recall that there exists a pairing of Hopf algebras ( , ) : U q (g) x A q (G) — ► 
K between A q (G) and U q (o) (see Section 1.3). This pairing induces a K-linear 
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mapping ip {-,<p) from A q (G) to U q (g) y = HoniK(J7 9 (g), K). As to the U q (o}- 
bimodule structure of A q (G), we can easily show by the definition (1.18) that 



(5.18) 



(c, a.p.b) = (bca, ip) 



for all a, b, c G U q (g) and ip G A 9 (G). This means that the natural mapping 
-<4 g (G) — > C/ 9 (fl) v is a homomorphism of [7 g (g)-bimodulcs. Hence, we see that 
A q (G) — > J/ g (fl) v is actually injective. If its kernel is nontrivial, the irreducible 
decomposition (1.23) implies that the kernel contains some irreducible component 
VT(A); this leads to a contradiction since the pairing U q (g) x W(\) — > K cannot be 
trivial for any A G P + . 

We now consider the subalgebra H = A q (K\G/K) of A q (G). From (5.18), it 
is immediately seen that an element ip G A q (G) is 6 g -biinvariant if and only if it 
satisfies 



(5.19) 



(U q (g)i q , l p)^0 and (t q U q ( Q ),p) = 0. 



This implies that there exists a commutative diagram 

A q (K\G/K) ► A q (G) 

(5.20) | 



(U q {Q)/U q {Q% + t q U q (Q)Y 



u g (sT 



where the four arrows are all injective. It should be noted here that the left action 
of a central element C G U q (g) on H = A q (K\G / K) corresponds by duality to the 
K-endmorphism of the quotient space U q (o) /U q {o)t q + t g U q (g) induced from the 
right multiplication by C in U q (g). 

The next step is to take the restriction mapping A q {K\G/K) — ► A(T) into the 
duality argument. In what follows, we denote by U q (t) the commutative subalgebra 
K[q h (h G P*)] of U q (o), regarding it as the quantum analogue of the Lie algebra 
t of the diagonal subgroup T. Then the pairing ( , ) between U q (g) and A q (G) 
induces a nondegenerate pairing between the subalgebra U q (t) and the quotient 
algebra A(T). For symmetry, we also use the notation 0t = q ek for 1 < k < N and 
set ( h = ■ ■ ■ (^'^ for any h G P*. With this notation, the pairing between 

U q (t) = K[C ±1 ] and A(T) = K[z ±1 ] is described by 



(5.21) 



(C'\z X ) = (h G P*, AG P). 



Then the diagram (5.20) is complemented as follows: 

A q (K\G/K) > A q (G) 

<5 - 22 » I I 



(C,(8)/t',(8)t, + t,t/»(8)) v 
Hence we have the commutative diagram 



A(T) 



(5.23) 



A q (K\G/K) 



(u q ( Q )/u q (Q)t q + t q u q ( & )y 



A(T) 
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where the arrow (U q (g)/U q (g)t q + t q U q (Q)) y — > U q (t) v is the transposition of the 
natural K-linear mapping U q (t) — > U q (o}/U q (g)t q + t q U q (g) which represents the 
"modulo reduction" of an element of C/ 9 (t) by the subspace U q {o)t q + t q U q (g). 

The pairing (5.21) between the two algebras of Laurent polynomials K[C ±:L ] and 
K[2; ±1 ] induces the "multiplicative Fourier transform" between g-difference oper- 
ators acting on them. We denote by K^ 1 ; T^] the K-algebra of g-difference 
operators in the form of finite sum 

(5.24) Q(C,T qX ) = ^a x (()T q \ ( a x (0 e nf 1 ] ), 

ASP 

where = •••T g A " jv . Similarly we denote by K^ 1 ; T^} the algebra of 
q-diffcrcncc operators in the variable z — (z\, ■ ■ ■ , Zn)- Between these two algebras 
of g-difference operators, there exists a unique anti-isomorphism of K-algebras 

(5.25) Q^Q: Kfc* 1 ; T%] -> K^ 1 ; T±'} 
such that 

(5-26) Ck = T q , Zk , f qXk =z k (1 < k < N). 

We will call Q = Q(z;T QtZ ) the Fourier transform of Q = Q((;T qX ). It is easy to 
see that 

(5.27) (Q(C; T qX )f((), g(z)) = (/(C), Q(z; T q , x )g(z)), 

for any /(C) G IK[C ±1 ] and g(z) G K[z ±1 ]. 

We are now ready to formulate our method to compute the radial component 
C|t of a central element of C e U q (g). 

Proposition 5.3. Let C be an element of U q (g) such that t q C C U q (g)t q . Then 
the left action of C on A q (G) preserves the subalgebra H = A q (K\G/K) of t q - 
biinvariants. Suppose that there exist a nonzero Laurent polynomial a(z) e K[z ±:L ] 
and a q-difference operator Q(£;T qX ) <G K[C ±:L ; T^ 1 ] such that 

(5.28) (a(T qX )f)C = Q(C; T qX )f mod U q (g)t q + t q U q (g) 

for any Laurent polynomial f = /(C) in U q (t) = K[C ]• Then the radial component 
C|t : H\j — > H\t "is given by the Fourier transform a(z)~ 1 Q(z;T qtZ )- Namely, one 
has 

(5.29) {C.tp)\ T = a{z)- l Q{z; T,, Z )( V | T ), 
/or any (p £ H.. 

Proof. It is clear that the left action of C preserves 7i. Note also that the right 
multiplication by C in U q (g) preserves the subspace U q (o)t q + t q U q (o). Let ip be 
an element of H. Then, for any element / = /(C) in U q {i) — IK[C ±:1 ] , we have 

(5.30) (f,a(z)(C.p)\ T ) = (a(T qX )f,C.p) = ((a(T qX )f(())C,p) 

= (Q((;T qX )f,<p) = (f,Q(z;T q , z )(<f>\ T )). 
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This shows that 

(5.31) a(z)(C.<p\ T ) = Q(z;T q , x )(<p\ T ) 
as desired. □ 

The computation of the radial component C\j is thus translated to the practical 
problem how to describe the reduction of elements in U q (t)C modulo U q (g)t q + 
tqU q (g), in terms of q- difference operators on U q (t) = K[^ ±1 ]. 

5.4- A recurrence formula related to Macdonald's q-difference operator. Our 
computation of the radial component of C\ will be carried out by using a recurrence 
formula for the "symbol" 

(5.32) £ A( 8l .-, tofc ,- x n ) 

of the g-difference operator in the left-hand side of (5.2). We introduce a family of 
rational functions F^ — Fij(x,£;t) € Q(t,a;)[£] (1 < i < j < n) in x = (x\, ■ ■ ■ ,x n ) 
and £ = (£i, • • • , £„). They are defined by the recurrence relations 

(5.33) 

i) F jj= ^ (l<j<n), 

ii) Fij = -7-^ — t —j-{ E Fik ~ E XkX^Fkj} (i<i<j< n). 

t{l XiXj ) ^ k<j . <k ^. 

Lemma 5.4. The rational functions Fij — Fij{x,^;t) defined above have the ex- 
plicit formulas 



XfcXj^{Xi , • • • , tXk , • • • , Xj ) 

for 1 < i < j < n. Furthermore, one has 



i<k<j ^ Xk x i){tXk Xj)A(xi,--- ,Xj) 



(5.35) £ t«-% j (x,Z;t)= X ^ A{Xl A(x ; tXkr x \' Xn) - 

l<i<j<n l<k<n ^ Xl > > Xn > 



In order to clarify the structure behind these formulas, we consider the upper 
unitriangular n x n matrix A(t) defined by 

(5.36) A(t)= e « + ( 1 -^ 1 ) E e «- 

We remark that the inverse of A(t) is given by 

(5.37) A{t)- l = J2 e« + (!"*) E 
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With this matrix A(t), we set A(x; t) = A(f)diag(xi, • • • , x n ). Then the recurrence 
relations in (5.33) is equivalent to the commutativity 

(5.38) [A(x;t),F(x,ti;t)}=0 

for the matrix F(x, £; t) = (Fij(x, £; t))i<ij< n defined by setting Fij(x, £; t) = for 
i > j. In other words, all the upper triangular matrices that commute with A(x; t) 
are parametrized by their diagonal entries £ = - ■ ■ , £ n ) an d the other entries 
are explicitly determined by (5.34). We remark that the matrix A(t) arise as the 
"diagonal" part of an i?-matrix as we will see later. 

A proof of Lemma 5.4 is given by diagonalizing the matrix A(x;t). It is clear 
that there exists a unique upper unitriangular matrix G(x; t) such that 

(5.39) A(x;t)G(x;t) = G(x;t)diag(xi, • • • ,x n ). 
With the matrix G(x;t), F(x,£;i) is realized as 

(5.40) F(x,S;t) = G(x;t)diagfa,--- ^ n )G{x;t)-\ 

Lemma 5.5. (1) The entries of the matrices G{x;i) — (Gfj(x;t))i<i,j< n 
G(x;t)^ 1 = (G~Ax;t))i<i,j< n are explicitly given by 



(5.41) G±(x;t)=t 



1-3 



i (1 - t)xj A(xj, ■ ■ ■ ,Xj^i,tXj) 



G-(x-t) = t i-j (Ll^i^Eii^+h^: 

(tXi Xj ) A(x^ ; • • • jlj) 

for 1 < i < j < n. 

(2) For any 1 < i < j < n, one has 

(5.42, z*-*°t^n= A %:: x ^\ 

i<k<j v *' ' 3 ' 

V C~ (x; t) ~ f-i A ^ tXi ' Xi+1 '"' ' Xj \ 
i<k<j 1 A(xi,---,Xj) 

Proof. Formula (5.39) is equivalent to the recurrence relations 

(5.43) (l-x l xJ 1 )G±(x;t) = (l-t- 1 ) ]T x k xj'G+(x;t) 

i<k<j 

for i < j with initial condition G~^- = 1. By comparing (5.43) and the formula 
obtained from (5.43) replacing i + 1 for i, we obtain 

(5.44) G±(x;t)=t- ^ 1 -^ Gi +lj (x;t). 



Hence we compute 



(5.45) G±(x;t)=t 



X% X j 



Ui<k<i x k -tX m 



T\i<k<j X k x j 



38 MASATOSHI NOUMI 

to get (5.41) for Gfj(x;t). On the other hand, from A(x; t)~ 1 G(x; i)diag(x) = 
G(x; t) we have 

(5.46) (xr 1 x j -l)G±(x;t) = (l-t) £ t^G+ix; t). 

i<k<j 

Formula (5.42) for G^{x:t) is an easy consequence of (5.41) and (5.45). The same 
method is available to prove formulas for G~-(x; t). □ 

Formulas (5.34) and (5.35) of Lemma 5.4 follows immediately from (5.41) and 
(5.42) of Lemma 5.5, respectively. 

From the above description (5.40), we also see that the matrix F(x, £; t) has the 
multiplicative property 

(5.47) F(x, l;t) = id, F(x,£;t)F(x,r);t) = F(x,£r};t) and F(x, x; t) = A(x; t). 

We remark that the formula (5.35) is also related to the Hall-Littlewood polyno- 
mials P(t){x; t) (£ = 1, 2, • • • ) for the Young diagrams of one row. In fact, by the 
substitution £ k = x l k (1 < k < n), the right-hand side of (5.35) gives rise to 

(5.48) P {t) (x;t) = g> A(x u ...,x n ) ' 

for I = 1,2, - ■■ (see [Ml]). 

5.5. Proof of Theorem 5.2. We determine the radial component of the central 
element C\ € U q (g) in the two cases (SO) and (Sp). Taking an arbitrary h <G P* , we 
will compute the reduction of the element q h C\ — ( h C\ modulo U q (g)t q + t q U q (g) 
to find an explicit representative of its modulo class in U q (t). 

In view of (5.12), we begin with looking for relations among the modulo classes 
of q h LfjS(L k ~ £ ). For this purpose we use the commutation relations 

(5.49) LfS(L^) t R+ t2 =R+ t2 S(Lz) t Lt. 
Note also that we have 

(5.50) q h L + = H~ 1 L + Hq h , q h S{L-) = H- 1 S(L-)Hq h , 

for the constant matrix H — di&g(q( h ' ei \ • • • ,q( h ' en ">). By using (5.49) and (5.50), 
we compute 

(5.51) 

q h L+S(L-fR+ 2 t2 = q h R+ 2 t2 S(L-YL+ 

= R+ 2 t2 H 2 S(L-) t H- 1 q h L+ 

= R+ 2 t2 H 2 J- 1 L+JH 2 7 1 q h L+ 

= q h R^ 2 H 2 J 2 1 H 2 L 2 H 2 1 J 2 H 2 1 L\ 

= q h R^ 2 2 H 2 J 2 1 H 2 L 2 H 2 1 J 2 H 2 1 J\S{L 1 )* 1 
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modulo U q (o)t q + t q U q (g). Hence we have 

(5.52) q h L+S(L 2 ) t R+ 2 t2 J 1 H 2 J 2 7 1 H 2 = q h R+ 2 2 J X H 2 J 2 X H 2 L+ S{L^f . 
By applying the matrix P\ 2 from the right, we have 

(5.53) q h L+S(L 2 ) t R+ 2 2 P 12 J 2 H 1 J{ 1 H 1 = q h R+ 2 2 P 12 J 2 H 1 J^ 1 H 1 L+ S(L 2 Y . 

This means that the constant matrix R = R\ 2 2 P\ 2 J 2 Hi Jf 1 Hi "intertwines" the 
modulo class of q h L^S(L 2 y. From this formula (5.53), we can derive necessary 
informations for determining the modulo class of q h Ci, by extracting its "diagonal 
part" . 

Let W = ©™ = i Kitj be the n-dimensional K- vector space with canonical basis 
{tti, • • • , u n }. For each case, we define below two K-linear mappings 

(5.54) l w : W -> V O k V and n w : V ® K V -> W. 

By using these mapping, we pull back the equality (5.53) by the composition 

(5.55) W ^V® K V ->V® k V 

to obtain the statement for n x n matrix Z = ttw ° (Lf S(L 2 Y) o u w with entries 
in U q (g). From now on, we treat the two cases (SO) and (Sp), separately. 

Case (SO): We define lw and ttw by 

(5.56) t\v(uk) — Vk ® v k (1 < k < n), nw(vi <8> Vj) = SijUj (1 < i,j < n). 
Under this definition, the matrix Z = w\y ° {L\ S(L 2 Y) ° tw takes the form 

(5.57) Z = (Zy)i<iJ<n, Za = L±S(LjA (1 <i,j< n). 

Lemma 5. 6. A. Set R = R\ 2 2 P\ 2 J 2 Pt\J^ x Pl\. Then we have 

(5.58) ttw o R = qA(q 2 )diag(q 2 ^>, • • • , q 2 ^) o tt w , 
Ro Lw = q Lw o A(q 2 )diag(q 2 ^ , • • • , q 2 ^), 

where A(t) is the matrix defined by (5.36). 

Lemma 5. 6. A is clear from the expression of Rf 2 2 P\ 2 : 

(5.59) #i2* 2 -Pi2 = e v e ^ qS%3 + ( q ~ q ^ e ^ e ^'- 

By using (5.58), we obtain the following formula for Z from (5.53): 

(5.60) q h ZA(q 2 ^;q 2 ) = q h A(q 2 < h ^;q 2 )Z mod U q ( Q )t q + t q U q ( ). 
Here we used the notation 

(5.61) A(q 2 ^-q 2 ) = A{q 2 )Amg(q 2 ^) 1 q 2 ^ = {q 2 ^ , • • • , q 2 ^). 
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This means that the modulo classes of q h Ztj satisfy the same recurrence relation 
as that of Fij(q 2 ^ h ' e \^;q 2 ) that we discussed in Section 5.4. Note that, as to the 
diagonal entries, we have 

(5.62) q h Z jj = q h q 2 ^ mod U q (g% + t q U q {g), 

for l<j<n. Taking ^ = A(q 2 ^)q 2e o (1 <j< n), we conclude inductively that 

(5.63) A{q 2 ^)q h Z tl = q h F 13 {q 2 ^\A{q 2 ^)q 2 ^-q 2 ) (1 < i,j < n), 

where q 2e — (q 2ei , • • • , q 2<Ln ). In fact, the both sides of (5.63) have the same initial 
values for j — i = and satisfy the same recurrence relations for j — i > 0. Recall 
that 

(5.64) C 1= J2 q 2(n - l) L+S(LJ i )= J2 f^Zir 



Hence we obtain the following expression for the modulo class of A{q 2 ^ h ^)C\ by 
Lemma 5.4: 

(5.65) A{q 2 ( h > ei \ ■ ■ ■ ,q 2 ^ h ' e ^)q h C 1 

n 

= J2q h+2e "A(q 2 < h ^,...,q 2 q 2 < h ^\...,q 2 < h ^). 
fe=i 

In terms of the operators in the variables £ = ((i, • • • , this formula can be 
rewritten as 

n 

(5.66) A(T g 2 Ci ,... ,Tl<M0C=J2$ A Kc^---^ 2T lc^---KcJf(0 

fe=i 

for any f(() G K[C ±1 ] = U q (i). By Proposition 5.3, we finally get the explicit 
formula for the radial component 



(5 - 67) ClW = h ^,-..,4) T , 



as the Fourier transform of (5.66). On the subalgebra K[xi, ■ ■ ■ ,x n ] 6n of H, con- 
sisting of symmetric polynomials in x\ — z 2 ,--- ,x n = z 2 , this reduces to the 
(j-difference operator 

(5.68) D 1 = ± A(^--, 9 ^---,^) 

in the variables x — (x\, ■ ■ ■ ,x n ). This completes the proof of Theorem 5.2 for 
Case (SO). 



Macdonald polynomials on quantum homogeneous spaces 41 

Case (Sp): In Case (Sp), we define the linear mapping Lw ■ W — > V ®k V by 

(5.69) iw(uk) = V2k-i ® V2k-i + V2k <B> v 2 k {l<k<n), 
The linear mapping nyy ■ V ®k V ^> W is defined as follows: 

(5.70) TTw(v 2 k-l <8> V2k-l) = QUk, TT W (v 2 k <8> «2fc) = g _1 Mfe (1 < k < Tl) 

and TTw{vi <S> i>j) = for the other pairs (z, j). With these linear mappings, we see 
that the entries of the matrix Z = nw L^S^L^) ° tw are given by 

(5.71) =5-C'2i_i i 2j-l'S'(-^2j-l,2i-l) + 9-^2i-l,2j^(-^2j,2i-l) 

+ 9 ^2i,2j-l'S , (^'2j-l,2i) + ? L 2i,2jS( L 2j2i ), 

for 1 < i,j < n. We also see that the central element Ci is rewritten in terms of 
Zij as follows: 

(5.72) d=q J2 1 4{n ~ i)z ij- 

l<i,j<n 

By a direct computation, one can prove 

Lemma 5.6.B. For the matrix R = R^ 2 Pi 2 J 2 HiJ^ 1 Hi, we have 
(5.73) 

ir w o R = -q 2 A{q A )dmg{q^ ei+ ^ , • • • , g(fc.^»-i+^»>) o tt^, 
Roi w = -q 2 L W oA(q 4 )diag{q( h ' ei+e2 \--- , g <^»-i+^»>). 

Setting ?fc = e2fe-i + £2fc for 1 < fc < n, we will use below the notations = 
((fV ,9 ? ") and = (q< h <^,--- ,q< h <^). By using (5.73), we obtain the 

commutation relation 

(5.74) q h ZA{q^-q i ) = q h A{q^;q i )Z mod U q (g% + t q U q (g) 
from (5.53). As for the diagonal entries of Z, we have 

(5.75) q h Z jj = q^qq^-i+q-'q 2 ^) = q h {q+q- 1 )q^ mod U q ( %+t q U q ( ), 
for 1 < j < n. Hence we have 

(5.76) A(q^)q h Z t3 EE q h (q + q- 1 )F t3 (q^\A(q^)q i ;q 4 ) (1 < i,j < n), 

by a similar inductive argument as in Case (SO). This leads to the following ex- 
pression for the modulo class of A(q^ h ' £ ' > )Ci by (5.72): 

(5.77) A(g< fc>Fl >,--- ,q {h ^ ) )q h C 1 

= (l + q 2 ) £ q^Fijiq^^iq^qt-q*) 

n 

EE (l+^^^'A^, - .tfV^,-" ,g< fc > ? »>). 
fe=l 
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In terms of the operators in the variables C = (Ci>" ,(2n), this formula can be 
rewritten as 

(5.78) A(f 1; ... ,T n )/(C)C 

n 

= (1 + <? 2 ) ^ C 2fc -iC2fe A(fi, • • • , g 4 f fc , • • • , f„)/(C) 
fe=i 

for any /(C) G K[C ±X ] = t/ g (t), where T fc = T^^T,,^ for 1 < fc < n. Hence, by 
Proposition 5.3, we get the explicit formula for the radial component 

(K 7Q\ /^l M i „2^\^ M z l z 2,- ■ ■ ,q 4 Z2k-lZ2k,- ■ ■ ,Z2n-lZ2n) rj, „ 

(5.79) Gi| T = (1 + g ) ^ -rj— 1 q,z 2k - 1 -Lq,z 2k 



k=l 



as the Fourier transform of (5.78). On the subalgebra K[xi, • • • ,x n ] C H of sym- 
metric polynomials in x\ = Z\z 2 , •■■ ,x n = z 2n -\Z2m this reduces to the g-difference 
operator 

(5.80) = (1 + q ) g A(ai> ... >a;|i) Tj„. 

This completes the proof of Theorem 5.2 for Case (Sp). 

§6. Scalar product and orthogonality. 

In this section, we will discuss the orthogonality relations for Macdonald's sym- 
metric polynomials P fl (x; q, t) with t = <p or t = q 2 which are obtained from their 
interpretation as zonal spherical functions on quantum homogeneous spaces. 

6.1. Invariant functional and Schur's orthogonality. Recall that there exists a 
unique homomorphism h G ■ A q {G) — > K of [/ 9 (g)-bimodulcs with h G {\) = 1- This 
invariant functional, corresponding to the Haar measure of the unitary group U(iV), 
is given as the projection A q {G) — > W(0) = K in the decomposition (1.23). We 
remark that the invariance of Iig means that, for any element a € U q (g), one has 

(6.1) h G (a.(p) = h G (ip.a) = e(a)h G (tp) (ip e A q (G)). 

By using the ^-operation of A q (G), we define a hermitian form ( , ) G on A q {G) by 
the formula 

(6.2) {<P,il>)G = hG(<p*1>) for <p,1> e A q {G). 

From the invariance of h G it follows that ( , ) G is invariant in the sense that 

(6.3) (tp,a.i/>} G = {a*.<p,ip) G 

for any a G U q (o) and <p,i[) <E A q (G). It is known that this hermitian form is 
nondegenerate, and induces a positive definite hermitian form when q is specialized 
to a real number with \q\ ^ 0, 1 (see [NYM], for instance). 



Macdonald polynomials on quantum homogeneous spaces 43 

The orthogonality relations for our zonal spherical functions tp(X) (A G P e + ) come 
from Schur's orthogonality relations for the matrix elements of irreducible represen- 
tations V(X). For each dominant integral weight A G P + , we fix a nondegenerate 
U 9 (7V)-invariant hermitian form ( , ) on V(X) as in Section 4.4. In what follows, 
we set 

N 

(6.4) p = Y J (N-k)e k . 

fe=i 

The orthogonality relations for the matrix elements 4>\{u,v) for u, v G V(X) are 
formulated as follows. 

Proposition 6.1. Let A, fi be two dominant integral weights in P + and take nonzero^ 
vectors u,v G V(X) and u',v' G V(p). If A 7^ fi, one has 

(6.5) (Mu,v),^(u',v')) G = 0. 
If X = n, one has, 

(6.6) (Mu,v),Mu',v')) G = J^( q P.u\qP.u)(v,v'), 

where d(X) is the following principal specialization of the Schur function s\: 

(6.7) d(X)= Sx (q^), q^ = ( q * N -V, q * N -V,...,l). 



We omit the proof of Proposition 6.1, since it is a variant of Schur's orthogonality 
already given in Woronowicz [W] and [NYM]. 

6.2. Orthogonality of zonal spherical functions. The zonal spherical function 
(p(X) (A e P { + ) is a matrix element of the representation V(X). From this fact, 
it directly follows that, if A and A' arc two distinct weights in P { + , one has the 
orthogonality relation (ip(X), ip(X'))c = 0. This fact is also proved by the fact that 
the central element C\ of U q (g) is self-adjoint with respect to the hermitian form 
( , )c 

For the description of the square length (y(A), (^(A))g of ip, we need to specialize 
appropriately the parameter a £ (K*) n involved in the definition of the coideal 
t q = t q (a). In what follows, we set 

(6.8) Case (SO): a = {q^^ , q^- 2 ^ , • • • , 1), 

Case (Sp): a = (g 2( "- 1} , q 2{n - 2 \ ■ ■ ■ ,1). 

Proposition 6.2. For the special value of a G (K*) n in (6.8), the algebra H = 
A q {K\G/K) of i q -biinvariant elements is a *-subalgebra of A q (G). 

Proof. We first consider Case (SO). In view of Lemma 4.13, we have only to show 
that <ys(2A r )* (1 < r < n-1) and (dct 9 (T) ±1 )* belong to H again. As to det g (T) ±1 , 
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this statement is clear since det 9 (T)* = det 9 (T) 1 . Note that, under the special- 
ization (6.8), the element <p(2A r ) takes the form 

(6.9) ^(2A r )= £ (g)V" H|J|1 , 

|/| = |J|=r 

where ||/|| = J2 ieI i- Hereafter we use the notation £j — £j\'.'.'.j r r for I = {i\ < ■ ■ ■ < 
i r } and J = { j 1 < ■ ■ ■ < j r }. Recall from [NYM] that, for each 7, J C {1, 2, • • • , N} 
with |/| = | J| = r, we have 

(6.10) (#)* = (- 9 )-ll J ll + ll J H^cdet,(T)- 1 ) 

where I c stands for the complement of I in {1, 2, • • • , N}. Hence we compute 

(6.11) ^(2A r )* = dct 9 (T)- 2 ]T (^)V l|/|l+l|J|l -^(2A„_ r -2A„) 

\I\ = \J\=r 

by (4.36). This proves that TL is closed under the ^-operation in Case (SO). 
In Case (Sp), the element </?(A 2r ) can be written in the form 

(6.12) „(A 2r ) = £ eV (l|/|H|J|l) , 

|/| = |J|=r 

for each 1 < r < n. In (6.12), we used the notation £j to refer ^J-i'^ '% r 

for two subsets I = {i\ < ■ ■ ■ < i r } and J = {ji < ■ ■ ■ < j r } of {1, 2, • • • , n}. Since 

(f j)* = {-q) 4{ - m+llJm £jcdet q (T)-\ we compute 

(6.13) tp(A 2r y - det^T)- 1 £ e5^" 2||/|l+2||J|l =v(A2(n-r)-A2„), 

|/| = |J|=r 

where I c stands for the complement of / in {1, 2, • • • , n}. Hence Lemma 4.13 implies 
that H. is closed under the *-operation also in Case (Sp). □ 

Another way to prove Proposition 6.2 is to show the left ideal U q (g)t q and the 
right ideal i q U q (o) are both stable under the involution r (sec (1.31)). This fact 
can be checked directly by using the generator system described in Proposition 2.4. 

Under the specialization of the parameters a — (ai,--- ,a n ) as in (6.8), we 
have an expression of the square length (ip(X),ip(X))a in terms of the principal 
specialization of ip(\). 

Proposition 6.3. The zonal spherical functions ip(\) (A e P { + ) form an orthogonal 
basis of the algebra TL. For each A e , the square length of tp(\) is given by the 
formula 

(6.14) MA),^(A)) G -' (Ai " 



d(A) ' 



where c(A) = (q p ,<f(\)) stands for the value of ip(X) at the point q p e T of the 
diagonal subgroup. 

For the proof of Proposition 6.3, we describe how the *-operation acts on the 
coideal t q . 
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Lemma 6.4. The coideal t q = t q (a) for the parameter a of (6.8), one has 6* = 
q~ p t q q p . Accordingly, if w £ ^(A) is a t q -fixed vector, then q~ p .w gives a t* -fixed 
vector. 

Proof. Setting D = diag^- 1 ), q( N ~ 2 \ ■ • • , 1), we have 

(6.15) q- p Mq p = DL+D- 1 - JD^SiL-fDJ- 1 

= D(L+ - D- 1 JD- 1 S(L-) t DJ- 1 D)D- 1 . 

For the value (6.8) of a, one can check easily the matrix D^JD^ 1 = D^ 1 J(a)D~ 1 
is a scalar multiple of J(a _1 ). This shows that q~ p t q (a)q p = t g (a _1 ) = t q (a)* as 
desired. □ 

Proof of Proposition 6.3. Let us take the vectors w(A), w*(X) as in the definition 
(4.4). Then by Lemma 6.4, we must have w*(X) = q(P' X ) q~ p .w(X), so that 

(6.16) ip(\) = q M M<i- p = qM M^wU-^ 

(u, u) ' (u, u) 



where w = w(X) and u = u(\). Hence we have, 
(6.17) c(X) = (q p ^(\))=e(v(\).q p ) = q 



(u,u) 

On the other hand, we have 

(6.18) {vWMWg = ^ {Mq ~"- W > w) > M f P - W > W))G 

(u,u) 

1 2<p,A)(^' W ) 2 



:9 



2 ' 



d(\) (u, u) 

by Proposition 6.1. Comparing (6.17) and (6.18), we obtain the expression of 
(6.14). □ 

6.3. Description of orthogonality on the diagonal subgroup. From this subsection 
on, we take the field K = C of complex numbers as the ground field and assume 
that q is a real number with < \q\ < 1. 

We now consider to describe the invariant functional ho ■ H — > C on the di- 
agonal subgroup T = (C*)^. For this purpose we use the subalgebra C[x] e ™ = 
C[xi, • • • ,x n ] 6n of TC\t of symmetric polynomials in the following variables: 

(6.19) Case (SO): x x = z\, ■ ■ ■ , x n = z%, 

Case (Sp): xi = z x z 2 , •■■ ,x n = z 2n -iZ2n- 



In what follows, we denote by 1Z the subalgebra of Tt such that 1Z\j — C[x] e " . Let 
us consider only the highest weights A £ P e + that are parametrized by the partitions 
/x = (/ii, • • • , fi n ) (Mi > • • • > A*n > 0) as follows: 

n 

(6.20) Case (SO): A = ^2/i fe e fe , 

k=i 

n 

Case (Sp): A = y"^ fc (e 2 fc-i + e 2 fc). 



k=i 
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Note that this parametrization can be graphically described as the duplication 
of Young diagrams, in the horizontal direction in Case (SO) and in the vertical 
direction in Case (Sp). As we noticed in Remark 4.14, the zonal spherical functions 
V?(A) parametrized by partitions as above form a C-basis of the subalgebra 1Z. 
Furthermore, we know by Theorem 5.1 that, for each (p(X) € 1Z, its restriction 
to the diagonal subgroup T coincides with the Macdonald symmetric polynomial 
Pp(x) = P^(x; g 4 , q 2 ) in Case (SO), and with P^x) = P fi (x;q 2 ,q i ) in Case (Sp), 
respectively. Note also that P^{x) form a C-basis for the algebra C[x] s " as [i ranges 
over all partitions. 

On the subalgebra 1Z, the invariant functional ha ■ TZ — > C is described in terms 
of the following meromorphic function on the algebraic torus (C*) n : 



(6.21) w(x;q,t)= ] \ 



{x%l Xj , ^) oo (Xj j Xi , q) c 



! n (tXi/xj;q) 00 (tXj/xi;q) 00 

where (a;q)oc = OfcLo ~ a( l k )- For a holomorphic function F(x) defined in a 
neighborhood of the torus T = {x = (x\, ■ ■ ■ ,x n ) G (C*)™; \x\\ = ■ ■ ■ = \x n \ = 1}, 
we use the notation 

(6-22) [F{x)]l= (—L\ n f F(x u ...,x n ) dXl --- dXn 

to refer the constant term in the Laurent expansion of F(x). 

Proposition 6.5. Let ip be an element in the subalgebra 1Z of H. and F(x) = ip\j 
the corresponding symmetric polynomial in C[x]. Then the value hc(^p) of the 
invariant functional is described by the formula 

(6.23) hoiy) = [w{x)l , 

where the weight function w(x) is given by 

(6.24) Case (SO): w(x) = w(x; q 4 , q 2 ), 

Case (Sp): w(x) = w(x;q 2 ,q A ). 



Proof. It is well known that Macdonald's symmetric polynomials P^x) have the 
property 

(6.25) [P^(x)w(x)} 1 = for ^ 0. 

(This is equivalent to saying that P^ is orthogonal to 1 if fi 0.) Since P^(x) form 
a C-basis for C[x] e ", this property determines the functional F >—> [F(x)w(x)] 1 on 
C[a;] e " up to scalar multiples. Hence, the proof of Proposition 6.5 is reduced to 
show that the left hand side of (6.23) has the same property, when it is regarded as 
a functional on C[x] s ". It can be done by using the invariance of the functional ha- 
In fact, property (6.1) implies that, for the central element C\ of U q (o) in (5.12), 
we have 



(6.26) Md-V) =s(Ci)h G (<p) for any <fi G A g (G), 
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where e(C\) = J2k=i ^ ■ F° r cacn ^ e ^t + i tric zonal spherical function <p(A) 
is an eigenfunction of C\ with eigenvalue Xa(Ci) = SjLi q 2< - Xk+N ~ k \ Hence we 
have 



(6.27) xx(Ci)h G ( v (X)) = e(Ci)MvW)- 

from (6.26). Since xa(Ci) 7^ e(Ci) unless A = 0, we have /ig(<^(A)) = for any 
A 7^ 0, as expected. □ 

In our setting, the scalar product ( , )' q t of Macdonald [M2] takes the form 

(6.28) ( F,G )' = ^ [F(x)*G(x)w(x)] 1 . 

Here the ^-operation on C[x] is given x* k — x^ 1 for 1 < k < n. Note that, with 
this *-operation, C[x] is a *-subalgebra of A(T) endowed with the *-operation such 
that z* = zj for 1 < j < N. Recall that the subalgebra H is closed under the 
*-operation of A q (G) representing the quantum unitary group (Proposition 6.2). 
Since the restriction mapping TL — > A(T) is a *-homomorphism, Proposition 6.5 
implies that the hermitian form ( , )a is related to Macdonald's scalar product 
through 

(6-29) M)g= (J^L, 

if <p,ip e 1Z and ip\j — F(x), ip\j — G{x). 

Proposition 6.1 and formula (6.29) implies that Macdonald's symmetric polyno- 
mials Pfi are orthogonal under the scalar product ( , )'. Furthermore, as to the 
square length of P^, we have 



(6.30) 



(1,1)' d(A)' 
by Proposition 6.3. 

6.4- Computation of the ratio (P M , P M )'/(1, 1)' . In the rest of this section, we 
will evaluate the ratio (6.30) of square lengths, by using a result of Macdonald on 
the value of the principal specialization of P M . 

We first recall a result of Macdonald [M2] on the principal specialization of Mac- 
donald's symmetric polynomials P^(x;q,t) : For each partition fi = (fi\, ■ ■ ■ ,/i„), 
one has 

T-T 1 — ft 11 ' ( S )f-£' ( S )+ n 

(6.31) p„ (t »-\ e-\ . . . , i ;q ,t) = t ^-^ n x-Lcw+i ■ 



In formula (6,30), the symbols a(s), a'(s),£(s), l'{s) stand for the arm-length, coarm- 
length, leg-length, coleg-length of a box s in the Young diagram jj,, respectively. If 
the box s has the coordinates (i,j) (1 < i < n, 1 < j < in) in the Young diagram, 
they are given by 



(6.32) 



a(s) = in- j, a'(s) = j - 1, £(s) = p! j - i, l'{s) = i - 1, 
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where p! denotes the conjugate partition of fi. We also remark that (6.31) is a 
generalization of the following well-known formula for the Schur functions s fl (x) — 



(6.33) s^q n -\ q n ~\ ••-,!) = <fl=^-^ * _ ^ , 



where c(s) = a'(s) — £'(s) + n and h(s) = a{s) + £(s) + 1 arc the content and the 
hook-length of the box s. At present, the author does not know whether the princi- 
pal specialization (q p ,tp(\)) of the zonal spherical function tp(\) can be effectively 
evaluated as in (6.31), within the framework of quantum homogeneous spaces. 

As to the value (P f _ l (x;q,t) 7 P^(x;q 7 t))' qt of the scalar product, the following 
formula is proposed by Macdonald [M3]: For each partition n. = ■ ■ ■ ,p n ), one 
has 

(P M (a;;g,t),P M ( a ;; g ,t))^ n (1 - g °'W f -<'(«)+n) (1 _ 

( ' ' (l,l)' ? ,t L\^(l- q a>(s)+l t -e>(s)+n-l)(l_ q a(s) t e(s)+iy 

We will derive this formula for the two special cases corresponding to Cases (SO) 
and (Sp), by using our expression (6.30) and Macdonald's formula (6.31) for the 
principal specialization. 

Case (SO): In this case, the point q p = (g n_1 , q n ~ 2 , ■ ■ ■ ,1) gives the value x = 
( g 2(n-i) )? 2(n-2) ) ... Hence we have 

(6.35) C(A) = P^(q 2(n -V , q 2 ^ 2 ) , • • • , 1; q\ q 2 ) 

1 n 2(2a'{s)-l'(s)+n) 
q J- J- 1 a 2(2a( S )+£( S ) + l) ' 

sen 

replacing (q,t) in (6.31) by (q 4 ,q 2 )- On the other hand, we compute 
(6.36) 

d(\) = s\(q 2( - n ~ 1 \q 2( - n ~ 2 \ ■ ■ ■ ,1) 



1 q 2(a'(p)-l'(p)+n) 
11 1 _ n 2(a(p)+e(p) + l) 



P ex q 



(I _ 2(2a'(s)-t'(s)+n)\r l _ 2{2a' (s)-t' {s)+n+\)\ 
( X 2(2a( S )+£( S ) + l))( 1 2(2a( S )+£(s)+2)) ' 



sen 



The last equality follows from the simple fact that the Young diagram A = 2/x is the 
duplication of p in the horizontal direction. When we reparametrize the factors by 
the boxes in /i, each horizontally adjacent pair of boxes p in A, corresponding to a 
same s in /z, gives rise to the two factors with a(p) replaced by 2a(s) ,2a(s) + 1, and 
with a'(p) replaced by 2a' (s) ,2a' (s) + 1. Combining (6.35) and (6.36), we obtain 

ffi W ( P ^ P ^' = = FT (1 - g 2(2a'( S )-^)+n) )(1 _ g 2(2a( S )+£( S )+2) ) 

^ ' (1,1)' d(X) 11 (1 - q 2(2a'(s)-l'(s)+n+l)^ 1 _ q 2(2a(s)+l(s)+\)y 

This is exactly the formula obtained from (6.34) replacing (q A 7 q 2 ) for (q,t). 
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Case (Sp): In this case, the point q p = (q 2n 1 ,q 2n 2 ,--- ,1) corresponds to the 
value x = g^"- 1 )),^"- 2 ),- • • , 1). Replacing (q,t) in (6.31) by {q 2 ,q 4 ), we have 

(6.38) C(A) = 9 S fc=1 M*P M ( g 4(„-l) )g 4(„-2) ) ... ^.tfrf) 



5 



On the other hand, we compute 



EJf=i(«-3)M* JJ 1 g 



1 _ „2(a'( S )-2£'( S )+2n) 



„2(a(s)+2£(s)+2) 



(6.39) 

d(A)= SA ( <z 2 ( 2 - 1 ), g 2 ( 2 "- 2 ),...,l) 

i _2(a'(p)-£'(p)+2n) 



. „2(a(p)+*(p) + l) 
PGA y 



2K _ l( 4^3 )fli H (1 - g 2(a'M-2/'( a)+ 2n) )(1 _ g 2(a' (,)-2<' («) + 2n- 1) ) 
9 11 (1 _ g 2(a(s)+2£(s)+l)^ 1 _ 9 2(o(s)+2<(s)+2)) 



This time the Young diagram A = (2//)' is the duplication of /U in the vertical 
direction. Accordingly, £(p) should be replaced by 2£(s),2£(s) + 1, and £'{p) by 
2£'(s),2£'(s) + 1. Combining (6.38) and (6.39), we obtain 

(P,P)' c(A) 2 -,-r (1 - (? 2 ( a '( s )- 2£ '( ;s )+ 2 "))(l - 9 2 («(s)+ 2 ^(s)+i)) 



(6.40) — — ^— — = — TT — 2 

1 j (1,1)' dA) 11 (1 



(1,1)' d(\) (1 - g 2(a'(s)-2<'(s)+2n-l))( 1 _ g 2(a(s)+2<?(s)+2)) ' 

This coincides with the formula obtained from (6.34) replacing (g 2 ,g 4 ) for (<7,t). 
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